Major Upgrade of Betzy 2024
During the summer of 2024, we will upgrade our supercomputer Betzy in two phases. The first phase involves only the administration and backed nodes and shouldn’t affect users except for the downtime in June/July.
During the second phase, we will upgrade the operating system and software of all login and compute nodes. This process requires the recompilation and installation of all scientific software and libraries, including compiler tool chains.
Note
The new software stack is now ready for testing on login node 3. Use it in
job scripts by initiating jobs from this node. Connect via ssh USERNAME@login-3.betzy.sigma2.no
and launch jobs to utilize the stack. We’ve
reserved 80 compute nodes, including a GPU node, for this purpose.
Please report any issues with the new system.
Tool Chains
Maintaining old software consumes a significant amount of time, and as we are a small team, we must focus our resources on maintainable software packages and versions to provide good support for our users. Therefore, we will only install tool chains and software packages that are at least somewhat up-to-date. We have decided to install the last four published versions of the FOSS (based on GCC) and Intel tool chains (as distributed by EasyBuild).
The following tool chains will be available after the update:
foss/2022a
foss/2022b
foss/2023a
foss/2023b
intel/2022a
intel/2022b
intel/2023a
intel/2023b
Additionally, the following derivatives will also be available after the upgrade:
gompi/2022a
gompi/2022b
gompi/2023a
gompi/2023b
iompi/2022a
iompi/2022b
iompi/2023a
iompi/2023b
Tool Chains That Will Be Removed
The following tool chains will be removed during the upgrade and will not be available any longer:
foss/2019a
foss/2019b
foss/2020a
foss/2020b
foss/2021a
foss/2021b
intel/2019a
intel/2019b
intel/2020a
intel/2020b
intel/2021a
intel/2021b
The same is true for derivative tool chains like gompi or iompi based on these versions.
Scientific software
Almost all modules installed on Betzy are based on one of the above-mentioned tool chains. We will reinstall newer versions of software packages based on the up-to-date tool chains. In most cases, that means that you will get a newer, more recent version.
Only very few packages will not be reinstalled and will not be available after the upgrade, see the list below.
You can check which easyconfigs, the recipes we use for installing, are available here: https://github.com/easybuilders/EasyBuild-easyconfigs/tree/develop/EasyBuild/easyconfigs/
If you critically depend on a certain version, please contact us at support@nris.no, and we will explore all options.
Software packages that will be removed
The following packages are only available for older tool chains and will therefore be removed during the upgrade:
Globus-CLI/3.6.0-GCCcore-11.2.0
GRASP/2018-foss-2019b
Keras/2.4.3-fosscuda-2020b
PCMSolver/1.3.0-gompi-2020b
Theano/1.1.2-fosscuda-2020b-PyMC
hipSYCL:
hipSYCL/0.9.1-gcccuda-2020b
andhipSYCL/0.9.2-GCC-11.2.0-CUDA-11.4.1
If your work depends on one of those packages, please write to us at support@nris.no, and we will find a solution together.