Conda

Introduction

Conda is a package manager and environment management system. It was originally developed to solve package management challenges faced by Python data scientists, and today is a popular package manager for Python and R.

Conda on Euler

Conda uses many small files, which doesn't work well with Euler's Lustre file systems.
We therefore recommend to use:

• Home directory but be aware of the 100k file limit.
• Scratch directory but be aware of the automatic clean up policy.
• Project directory

Don't use:

• Work directory

Containers

An Apptainer container with a conda installation inside it, is a way to work around the file limit of Storage systems.md#Home, because everything is stored in a single container file.

Links

• https://docs.csc.fi/support/tutorials/conda/#conda-on-parallel-file-system-such-as-lustre-in-puhti