Module-system

Software on the ML nodes is installed as modules. Which means when you login there are no software in you path. In order to use a specific software package you need to load the corresponding module first.

1. Login to the machine, example is for ml6

ssh USERNAME@ml6.hpc.uio.no  #USERNAME is your UiO username

2. Check if the software you want to use is available. example is to use Tensorflow

[user@ml6 ~] module avail tensorflow

---------- /software/easybuild/modules/all------
   TensorFlow/2.2.0-fosscuda-2019b-Python-3.7.4

3. To load the software module, example is to use Tensorflow 2.2.0

[user@ml6 ~]$ module load TensorFlow/2.2.0-fosscuda-2019b-Python-3.7.4

4. To check the currently loaded modules

[user@ml6 ~]$ module list

Currently Loaded Modules:
  1) GCCcore/8.3.0
  2) zlib/1.2.11-GCCcore-8.3.0
..

 31) NCCL/2.4.8-gcccuda-2019b
 32) TensorFlow/2.2.0-fosscuda-2019b-Python-3.7.4

5. After loading, the software is in your path and you may use it in your programs

[user@ml6 ~]$ python -c "import tensorflow as tf; print(tf.__version__)"

2020-11-16 11:19:00.068313: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1
2.2.0

6. After using the software unload it before using another one

[user@ml6 ~]$ module purge
[user@ml6 ~]$ module list
No modules loaded

7. If you do not find the software you are looking for send us a mail (itf-ai-support@usit.uio.no) and we will install it for you

8. FAQ

  •  I can not find the latest Python version, the version I installed is very old .
    • We use module system to provide all software, this includes python. So you need to load the module to get the python version you want
    • [@ml6 ~]$ module avail python/3
      
      ----------------------- /software/easybuild/modules/all ------------------------
      Python/3.8.2-GCCcore-9.3.0
      Python/3.8.6-GCCcore-10.2.0
      Python/3.9.5-GCCcore-10.3.0-bare
      Python/3.9.5-GCCcore-10.3.0
      Python/3.9.6-GCCcore-11.2.0-bare
      Python/3.9.6-GCCcore-11.2.0
      Python/3.10.4-GCCcore-11.3.0-bare
      Python/3.10.4-GCCcore-11.3.0 (D)
    • module load Python/3.10.4-GCCcore-11.3.0
    •  

  •  

 

Published Nov. 16, 2020 11:25 AM - Last modified Mar. 24, 2023 2:28 PM