Software News
This page lists significant changes to software provided on OLCF systems. The most recent changes are listed first.
Summit: OpenCE 1.5.0 (December 29, 2021)
OpenCE 1.5.0 is now available on Summit. OpenCE 1.5.0 is available for python versions 3.7, 3.8, and 3.9. These builds can be accessed by
loading the open-ce/1.5.0-py37-0, open-ce/1.5.0-py38-0, and open-ce/1.5.0-py39-0 modules, respectively.
The following packages are available in this release of OpenCE:
| Package | Version |
|---|---|
| Tensorflow | 2.7.0 |
| TensorFlow Estimators | 2.7.0 |
| TensorFlow Probability | 0.15.0 |
| TensorBoard | 2.7.0 |
| TensorFlow Text | 2.7.0 |
| TensorFlow Model Optimizations | 0.7.0 |
| TensorFlow Addons | 0.15.0 |
| TensorFlow Datasets | 4.4.0 |
| TensorFlow Hub | 0.12.0 |
| TensorFlow MetaData | 1.0.0 |
| PyTorch | 1.10.0 |
| TorchText | 0.11.0 |
| TorchVision | 0.11.1 |
| PyTorch Lightning | 1.5.4 |
| PyTorch Lightning Bolts | 0.4.0 |
| ONNX | 1.10.2 |
| Keras | 2.7.0 |
| Magma | 2.5.4 |
| XGBoost | 1.5.1 |
| Transformers | 4.11.3 |
| Tokenizers | 0.10.3 |
| SentencePiece | 0.1.96 |
| Spacy | 3.2.0 |
| Thinc | 8.0.13 |
| OpenCV | 4.5.3 |
| DALI | 1.9.0 |
| Horovod | 0.23.0 |
Andes: OS Upgrade (November 30, 2021)
On November 30, 2021, the Andes cluster will be upgraded to a newer (minor) version of the operating system. The table below summarizes the main changes. While recompiling is not required, it is recommended.
| Component | Old Version | New Version |
|---|---|---|
| Red Hat Enterprise Linux | 8.3 | 8.4 |
| Mellanox InfiniBand Driver | 5.3-1.0.0.1 | 5.4-1.0.3.0 |
| NVIDIA driver | 450.36.06 | 460.106.00-1 |
| Slurm | 20.02.6 | 20.02.7-1 |
Summit: OpenCE 1.4.0 (October 13, 2021)
OpenCE 1.4.0 is now available on Summit. OpenCE 1.4.0 is available for python versions 3.7, 3.8, and 3.9. These builds can be accessed by
loading the open-ce/1.4.0-py37-0, open-ce/1.4.0-py38-0, and open-ce/1.4.0-py39-0 modules, respectively.
The following packages are available in this release of OpenCE:
| Package | Version |
|---|---|
| Tensorflow | 2.6.0 |
| TensorFlow Estimators | 2.6.0 |
| TensorFlow Probability | 0.14.0 |
| TensorBoard | 2.6.0 |
| TensorFlow Text | 2.6.0 |
| TensorFlow Model Optimizations | 0.6.0 |
| TensorFlow Addons | 0.14.0 |
| TensorFlow Datasets | 4.4.0 |
| TensorFlow Hub | 0.12.0 |
| TensorFlow MetaData | 1.0.0 |
| PyTorch | 1.9.0 |
| TorchText | 0.10.0 |
| TorchVision | 0.10.0 |
| PyTorch Lightning | 1.4.4 |
| PyTorch Lightning Bolts | 0.3.4 |
| ONNX | 1.7.0 |
| Keras | 2.6.0 |
| Magma | 2.5.4 |
| XGBoost | 1.4.2 |
| Transformers | 4.9.2 |
| Tokenizers | 0.10.3 |
| SentencePiece | 0.1.91 |
| Spacy | 3.1.2 |
| Thinc | 8.0.8 |
| OpenCV | 3.4.14 |
| Horovod | 0.22.1 |
Summit: Software Installation/Default Software Changes (August 17-19, 2021)
Summit’s operating system will be upgraded to Red Hat Enterprise Linux 8 (RHEL 8) on August 17-19, 2021.
Warning
Codes should be rebuilt prior to running following the upgrade due to the OS and software changes.
As a result of the upgrade, the following new packages will become available:
| Package | Current Default | New Default |
|---|---|---|
| CUDA Toolkit | 10.1.243 | 11.0.3 |
| IBM Spectrum MPI | 10.3.1.2-20200121 | 10.4.0.3-20210112 |
| IBM XL | 16.1.1-5 | 16.1.1-10 |
| IBM ESSL | 6.1.0-2 | 6.3.0 |
Note
The OS-provided Python will no longer be accessible as python (including variations like /usr/bin/python or /usr/bin/env python); rather, you must specify it as python2 or python3. If you are using python from one of the modulefiles rather than the version in /usr/bin, this change should not affect how you invoke python in your scripts, although we encourage specifying python2 or python3 as a best practice.
In addition, the following packages will be upgraded to newer versions and the specific versions listed below will be removed from the system. If you need any of the specific versions scheduled to be removed, please contact help@olcf.ornl.gov.
| Package | Versions Removed | Versions Available |
|---|---|---|
| adios | 1.11.1, 1.13.1 | None |
| adios2 | 2.2.0, 2.4.0, 2.5.0 | 2.6.0 |
| amgx | 2.0.0.130.0, 2.0.0.130.1, 2.0.0.130.2 | 2.1.0-1 |
| apr | 1.6.2 | 1.7.0 |
| apr-util | 1.6.0 | 1.6.1 |
| automake | 1.16.1 | 1.16.2 |
| binutils | 2.31.1 | 2.33.1 |
| bison | 3.0.5 | 3.6.4 |
| boost | 1.59.0, 1.61.0, 1.66.0, 1.70.0 | 1.62.0, 1.72.0, 1.74.0 |
| bzip2 | 1.0.6 | 1.0.8 |
| c-blosc | 1.12.1 | 1.17.0 |
| cairo | 1.14.12 | 1.16.0 |
| ccache | 3.7.9 | 3.7.11 |
| cmake | 3.11.3, 3.12.2, 3.13.4, 3.14.2, 3.15.2, 3.17.3, 3.18.1, 3.18.2, 3.6.1 | 3.18.4 |
| cuda | 9.1.85, 9.2.148, 10.1.105, 10.1.168, 10.1.243, 11.0.1, 11.0.2, 11.1.0 | 10.2.89, 11.0.3, 11.1.1 |
| curl | 7.60.0, 7.63.0 | 7.72.0 |
| darshan-runtime | 3.1.5-pre1, 3.1.6, 3.1.7 | 3.2.1 |
| darshan-util | 3.1.4, 3.1.5-pre1, 3.1.6, 3.1.7 | 3.2.1 |
| emacs | 25.1 | 27.1 |
| essl | 6.2.0-20190419 | 6.1.0-2, 6.2.1, 6.3.0 |
| expat | 2.2.5 | 2.2.10 |
| flex | 2.6.3 | 2.6.4 |
| font-util | 1.3.1 | 1.3.2 |
| fontconfig | 2.12.3 | 2.13.92 |
| freetype | 2.7.1, 2.9.1 | 2.10.1 |
| gcc | 4.8.5, 5.4.0, 6.4.0, 7.4.0, 8.1.0, 8.1.1, 9.1.0, 9.2.0, 10.1.0 | 8.3.1 (OS), 9.3.0, 10.2.0, 11.1.0 |
| gdb | 8.0, 8.2 | 9.2 |
| gdbm | 1.14.1 | 1.18.1 |
| gdrcopy | 2.0 | 2.1 |
| gettext | 0.19.8.1 | 0.21 |
| git | 2.13.0, 2.20.1, 2.9.3 | 2.29.0 |
| git-lfs | 2.8.0 | None |
| glib | 2.56.2, 2.56.3 | 2.66.2 |
| gnupg | 2.2.3 | 2.2.19 |
| go | 1.11.5 | 1.15.2 |
| go-bootstrap | 1.7.1-bootstrap | None |
| gobject-introspection | 1.49.2 | 1.56.1 |
| gperf | 3.0.4 | 3.1 |
| gromacs | 2020, 2020.2 | 2020.4 |
| harfbuzz | 1.4.6, 2.1.3 | 2.6.8 |
| hdf5 | 1.10.3, 1.10.4, 1.8.18 | 1.10.7 |
| help2man | 1.47.4 | 1.47.11 |
| hpx | 1.3.0, 1.4.1 | 1.5.1 |
| htop | 2.0.2 | 3.0.2 |
| hwloc | 2.0.2 | 1.11.11, 2.2.0 |
| hypre | 2.11.1, 2.13.0, 2.15.1, develop | 2.20.0 |
| icu4c | 58.2, 60.1 | 67.1 |
| julia | 1.4.2 | 1.5.2 |
| kokkos | 3.0.00 | 3.2.00 |
| kokkos-nvcc-wrapper | 20200221 | 3.2.00 |
| libassuan | 2.4.5 | 2.5.3 |
| libbsd | 0.8.6, 0.9.1 | 0.10.0 |
| libevent | 2.0.21 | 2.1.8 |
| libfabric | 1.7.0 | 1.11.0 |
| libffi | 3.2.1 | 3.3 |
| libgcrypt | 1.8.1 | 1.8.5 |
| libgpg-error | 1.27 | 1.37 |
| libiconv | 1.15 | 1.16 |
| libjpeg-turbo | 1.5.90 | 2.0.4 |
| libksba | 1.3.5 | 1.4.0 |
| libpciaccess | 0.13.5 | 0.16 |
| libpng | 1.6.34 | 1.6.37 |
| libsigsegv | 2.11 | 2.12 |
| libsodium | 1.0.15 | 1.0.18 |
| libtiff | 4.0.9 | 4.1.0 |
| libunwind | 1.2.1 | 1.4.0 |
| libx11 | 1.6.5 | 1.6.7 |
| libxext | 1.3.3 | None |
| libxml2 | 2.9.8 | 2.9.10 |
| libxrender | 0.9.10 | None |
| libzmq (renamed from zeromq) | 4.2.5 | 4.3.2 |
| log4c | 1.2.4 | None |
| lz4 | 1.8.1.2 | 1.9.2 |
| magma | 2.1.0, 2.2.0, 2.3.0, 2.4.0, 2.5.1, 2.5.4 | 2.5.3 |
| mercurial | 3.9.1, 4.4.1 | 5.3 |
| mpip | 3.4.1, 3.4.1-1 | 3.5 |
| mumps | 5.0.1 | 5.3.3 |
| nano | 2.6.3 | 4.9 |
| nasm | 2.13.03 | 2.15.05 |
| nco | 4.6.9, 4.8.1, 4.9.1 | 4.9.3 |
| ncurses | 6.1 | 6.2 |
| netcdf-c (renamed from netcdf) | 4.6.1, 4.6.2 | 4.7.4 |
| netcdf-cxx (renamed to netcdf-cxx4) | 4.2 | 4.3.1 |
| netcdf-fortran | 4.4.4 | 4.4.5 |
| netlib-scalapack | 2.0.2 | 2.1.0 |
| npth | 1.5 | 1.6 |
| numactl | 2.0.11 | 2.0.14 |
| openblas | 0.3.5, 0.3.6, 0.3.9 | 0.3.12 |
| open-ce | 1.1.3 | 1.2.0 |
| openmpi | 4.0.3 | 4.0.5 |
| papi | 5.5.1, 5.6.0, 5.7.0 | 6.0.0.1 |
| parallel-netcdf | 1.8.0, 1.8.1 | 1.12.1 |
| patchelf | 0.9 | 0.10 |
| pcre | 8.42 | 8.44 |
| perl | 5.26.2 | 5.30.1 |
| petsc | 3.10.1, 3.10.3, 3.6.3, 3.6.4, 3.7.2 | 3.14.1 |
| pgi | 17.10, 17.9, 18.1, 18.10, 18.3, 18.4, 18.5, 18.7, 19.1, 19.10, 19.4, 19.5, 19.7, 19.9, 19.10 | 20.1, 20.4 |
| pixman | 0.34.0, 0.38.0 | 0.40.0 |
| pkgconf (renamed from pkg-config) | 1.4.2, 1.5.4 | 1.7.3 |
| py-certifi | 2017.1.23 | 2020.6.20 |
| py-cython | 0.28.3, 0.29 | 0.29.21 |
| py-docutils | 0.13.1 | 0.15.2 |
| py-h5py | 2.8.0 | None |
| py-mpi4py | 3.0.0 | 3.0.3 |
| py-nose | 1.3.7 | None |
| py-numpy | 1.15.1 | 1.19.4 |
| py-pip | 10.0.1 | None |
| py-pkgconfig | 1.2.2 | None |
| py-pygments | 2.2.0 | 2.6.1 |
| py-setuptools | 40.2.0, 40.4.3 | 50.3.2 |
| py-six | 1.11.0 | None |
| py-virtualenv | 16.0.0 | None |
| python | 2.7.15-anaconda2-5.3.0, 3.6.6-anaconda3-5.3.0, 3.7.0-anaconda3-5.3.0, 2.7.12, 3.5.2, 3.7.0 | 2.7.15, 3.7.7, 3.8.6 |
| r | 3.5.2 | 4.0.5 |
| raja | 0.1.0 | 0.12.1 |
| rdma-core | 20 | 32.0 |
| readline | 6.3, 7.0 | 8.0 |
| renderproto | 0.11.1 | None |
| scons | 3.0.1 | 3.1.2 |
| screen | 4.3.1 | 4.8.0 |
| snappy | 1.1.7 | 1.1.8 |
| spectral | 20181227, 20190401, 20200714, 20200903 | 20210514 |
| spectrum-mpi | 10.2.0.10-20181214, 10.2.0.11-20190201, 10.2.0.7-20180830, 10.3.0.0-20190419, 10.3.0.1-20190611, 10.3.1.2-20200121 | 10.4.0.3-20210112 |
| sqlite | 3.23.1, 3.26.0 | 3.33.0 |
| subversion | 1.9.3 | 1.14.0 |
| superlu-dist | 4.3, 5.1.3, 5.4.0 | 6.4.0 |
| sz | 1.4.10.0, 1.4.12.3 | 2.0.2.0, 2.1.11 |
| tar | 1.30, 1.31 | 1.32 |
| tcl | 8.6.8 | None |
| tk | 8.6.8 | None |
| tmux | 2.2 | 3.1b |
| ucx | 1.7.0 | None |
| udunits (renamed from udunits2) | 2.2.24 | None |
| valgrind | 3.11.0, 3.14.0 | 3.15.0 |
| vim | 7.4.2367, 8.1.0338 | 8.2.1201 |
| xl | 16.1.1-4, 16.1.1-5, 16.1.1-6, 16.1.1-7, 16.1.1-9 | 16.1.1-8, 16.1.1-10 |
| xz | 5.2.4 | 5.2.5 |
| zfp | 0.5.0, 0.5.2 | 0.5.5 |
| zstd | 1.3.0 | 1.4.5 |
Summit: Software Installation/Default Software Changes (April 7, 2021)
The following modules were installed as default on April 7, 2021.
| Package | Current Default | New Default |
|---|---|---|
| open-ce | 0.1-0 | 1.1.3-py38-0 |
In addition, open-ce 1.1.3 is also available for python versions 3.6 and 3.7. These builds can be accessed by
loading the open-ce/1.1.3-py36-0 and open-ce/1.1.3-py37-0 modules, respectively.
The following packages are available in this release of open-ce.
| Package | Version |
|---|---|
| Tensorflow | 2.4.1 |
| TensorFlow Serving | 2.4.1 |
| TensorFlow Estimators | 2.4.0 |
| TensorFlow Probability | 0.12.1 |
| TensorBoard | 2.4.1 |
| TensorFlow Text | 2.4.1 |
| TensorFlow Model Optimizations | 0.5.0 |
| TensorFlow Addons | 0.11.2 |
| TensorFlow Datasets | 4.1.0 |
| TensorFlow Hub | 0.10.0 |
| TensorFlow MetaData | 0.26.0 |
| PyTorch | 1.7.1 |
| TorchText | 0.8.1 |
| TorchVision | 0.8.2 |
| PyTorch Lightning | 1.1.0 |
| PyTorch Lightning Bolts | 0.2.5 |
| XGBoost | 1.3.3 |
| Transformers | 3.5.1 |
| Tokenizers | 0.9.3 |
| SentencePiece | 0.1.91 |
| Spacy | 2.3.4 |
| Thinc | 7.4.1 |
| DALI | 0.28.0 |
| OpenCV | 3.4.10 |
| Horovod | 0.21.0 |
Summit: Software Installation/Default Software Changes (April 8, 2020)
The following modules were installed as default on April 8, 2020.
| Package | Current Default | New Default |
|---|---|---|
| ibm-wml-ce | 1.7.0-1 | 1.7.0-2 |
The new IBM Watson Machine Learning (WML) Community Edition (CE) install adds
improvements to DDL including support for jsrun.
Summit: Software Installation/Default Software Changes (March 10, 2020)
The following modules will be installed as default on March 10, 2020. The new stack requires the latest version of Spectrum MPI and as a result, previous versions have been deprecated.
| Package | Current Default | New Default |
|---|---|---|
| cuda | 10.1.168 | 10.1.243 |
| spectrum-mpi | 10.3.0.1-20190611 | 10.3.1.2-20200121 |
| hdf5 | 1.10.3 | 1.10.4 |
| pgi | 19.4 | 19.9 |
| xl | 16.1.1-3 | 16.1.1-5 |
| ibm-wml-ce | 1.6.2-3 | 1.7.0-1 |
In addition, the following new packages have been installed and are available for use:
| Package | New Version |
|---|---|
| pgi | 20.1 |
| xl | 16.1.1-6 |
| kokkos | 3.0.0 |
Finally, the FFTW installations on Summit for the XL compiler have been rebuilt
using -O2 to address an issue observed when running the FFTW suite using
the default optimization options. All builds of the fftw package that use
the XL compiler have been rebuilt.
If you encounter any issues, please contact help@olcf.ornl.gov.
Rhea: OpenMPI Upgrade (February 18, 2020)
On February 18, 2020, Rhea’s default OpenMPI will be updated to version 3.1.4. Due to underlying library changes that will be made on the same day, following the change, all codes should be rebuilt against the updated version.
| Package | Current Default | New Default |
|---|---|---|
| OpenMPI | 3.1.3 | 3.1.4 |
All Systems: Python2 End of Life (January 01, 2020)
On January 1, 2020, Python 2 will reach its end of life and will no longer be supported by the project’s core developers. On this date, the OLCF will also end its support for Python 2. Users reliant on Python 2 should port code to Python 3 for forward compatibility with OLCF systems and many open source packages. Python 2 modules will not be removed on January 1, but will no longer receive maintenance or regular updates.
While default Python modules on OLCF systems are already set to Python 3, we recommend all users follow PEP394 by explicitly invoking either ‘python2’ or ‘python3’ instead of simply ‘python’. Python 2 Conda Environments and user installations of Python 2 will remain as options for using Python 2 on OLCF systems.
Official documentation for porting from Python 2 to Python3 can be found at: https://docs.python.org/3/howto/pyporting.html
General information and a list of open source packages dropping support for Python 2 can be found at: https://python3statement.org/
Summit: Software Upgrade (July 16, 2019)
The following modules will be installed and will become the default on July 16, 2019. The new stack requires Spectrum MPI 10.3 PTF 1 and as a result previous versions of Spectrum MPI have been deprecated.
| Package | Default |
|---|---|
| cuda | 10.1.168 |
| spectrum-mpi | 10.3.0.1-20190716 |
Details about the software stack upgrade can be found in the IBM Service Pack 3.1 site and the Spectrum MPI 10.3.0.1 release notes.
Summit: Software Installation/Default Software Changes (May 21, 2019)
The following modules will be installed as default on May 21, 2019. The new stack requires Spectrum MPI 10.3 and as a result previous versions of Spectrum MPI have been deprecated.
| Package | Default |
|---|---|
| xl | 16.1.1.3 |
| cuda | 10.1.105 |
| essl | 6.2.0-20190419 |
| spectrum-mpi | 10.3.0.0-20190419 |
Rhea: Default Software Changes (March 12, 2019)
The following modules will become the default on March 12, 2019.
| Package | Default |
|---|---|
| intel | 19.0.0 |
| pgi | 18.10 |
| gcc | 6.2.0 |
| cuda | 10.0.3 |
| openmpi | 3.1.3 |
| anaconda | 5.3.0 |
| adios | 1.11.1 |
| atlas | 3.10.2 |
| boost | 1.67.0 |
| fftw | 3.3.8 |
| hdf5 | 1.10.3 |
| nco | 4.6.9 |
| netcdf | 4.6.1 |
| netcdf-fortran | 4.4.4 |
| netcdf-cxx | 4.3.0 |
| parallel-netcdf | 1.8.0 |
Summit: Default Software Changes (March 12, 2019)
The following modules will become the default on March 12, 2019.
| Package | Current Default | New Default |
|---|---|---|
| spectrum-mpi | unset | 10.2.0.11-20190201 |
| xl | 16.1.1-1 | 16.1.1-2 |
| pgi | unset | 18.10 |
In addition, the following default Spectrum MPI settings will be changed to address issues resolved with the February 19, 2019 software upgrade:
| Environment Variable | Current Default | New Default |
|---|---|---|
| OMP_MCA_io | romio314 | romio321 |
| OMPI_MCA_coll_ibm_xml_disable_cache | 1 | unset |
| PAMI_PMIX_USE_OLD_MAPCACHE | 1 | unset |