EasyBuild

This article is a draft

This is not a complete article: This is a draft, a work in progress that is intended to be published into an article, which may or may not be ready for inclusion in the main wiki. It should not necessarily be considered factual or authoritative.

EasyBuild is a tool for building, installing, and maintaining software on high-performance computing systems. We use it to build almost everything in our software repository, CVMFS.

EasyBuild and modules

One of the key features of EasyBuild is that it automatically generates environment modules which can be used to make a software package available in your session. In addition to defining standard Linux environment variables such as PATH, CPATH and LIBRARY_PATH, EasyBuild also defines some environment variables specific to EasyBuild, two of which may be particularly interesting to users:

• EBROOT<name>: Contains the full path to the location where the software <name> is installed.
• EBVERSION<name>: Contains the full version of the software <name> loaded by this module.

For example, the module python/3.10.2 on Narval defines:

• EBROOTPYTHON: /cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.10.2
• EBVERSIONPYTHON: 3.10.2

You can see the environment variables defined by the python/3.10.2 module using:

[name@server ~]$ module show python/3.10.2 | grep EB

Installation recipes and logs

EasyBuild keeps a copy of the recipe used to install each software package, as well as a detailed log inside of the installation directory. This is accessible in the directory $EBROOT<name>/easybuild. For example, for the python/3.10.2 module, the installation directory contains, amongst other things:

• $EBROOTPYTHON/easybuild/Python-3.10.2.eb
• $EBROOTPYTHON/easybuild/easybuild-Python-3.10.2-*.log

Using EasyBuild in your own account

You can use EasyBuild to install software in your own home or project directory space. You might do this if, for example, you want to customize a piece of 3rd-party software, or if you want to build a new version of something instead of waiting for staff add it to CVMFS.

Finding a recipe

An "easyconfig file" is a text file containing the information EasyBuild needs to build a particular piece of software in a particular environment. At Compute Canada we refer to these as "recipes". Writing a recipe from scratch will not be discussed here; you can find more about this in the EasyBuild documentation. Modifying a recipe for your particular situation is easier, and it is easier still to find a suitable recipe and use it unmodified.

...MORE NEEDED...

Choosing a toolchain

...MORE NEEDED...

Additional resources

• WestGrid webinar slides "Building software on Compute Canada clusters using EasyBuild"

CernVM File System