Software News

This page lists significant changes to software provided on OLCF systems. The most recent changes are listed first.


Frontier and Crusher: System Software Upgrade (July 18, 2023)

The Crusher TDS and Frontier systems were upgraded to a new version of the system software stack. This stack introduces ROCm 5.5.1 and HPE/Cray Programming Environment 23.05. For more information, please see:

Please contact help@olcf.ornl.gov with any issues or questions.


Frontier: Darshan Runtime 3.4.0 (May 10, 2023)

The Darshan Runtime modulefile darshan-runtime/3.4.0 on Frontier is now loaded by default. This module will allow users to profile the I/O of their applications with minimal impact. The logs are available to users on the Orion file system in /lustre/orion/darshan/<system>/<yyyy>/<mm>/<dd>.

Unloading darshan-runtime modulefile is recommended for users profiling their applications with other profilers to prevent conflicts.

Please make a note of this change and contact help@olcf.ornl.gov with any issues or questions.

Package Version
darshan-runtime 3.4.0

Summit: Darshan Runtime 3.4.0-lite (December 28, 2022)

The default version of Darshan Runtime has been updated on Summit to version 3.4.0-lite and is available via the darshan-runtime/3.4.0-lite modulefile. In addition, the default version for the companion set of tools provided in Darshan Util has been updated to darshan-util/3.4.0. Please note that darshan-util/3.4.0 is required to properly parse logs generated with darshan-runtime/3.4.0-lite.

Package Version
darshan-runtime 3.4.0-lite

Summit: OpenCE 1.5.2 (March 17, 2022)

OpenCE 1.5.2 is now available on Summit. OpenCE 1.5.2 is available for python versions 3.9, 3.8, and 3.7. These builds can be accessed by loading the open-ce/1.5.2-py39-0, open-ce/1.5.2-py38-0, and open-ce/1.5.2-py37-0 modules, respectively.

The following packages are available in this release of OpenCE:

Package Version
Tensorflow 2.7.1
TensorFlow Estimators 2.7.0
TensorFlow Probability 0.15.0
TensorBoard 2.7.0
TensorFlow Text 2.7.3
TensorFlow Model Optimizations 0.7.0
TensorFlow Addons 0.15.0
TensorFlow Datasets 4.4.0
TensorFlow Hub 0.12.0
TensorFlow MetaData 1.5.0
PyTorch 1.10.2
TorchText 0.11.2
TorchVision 0.11.3
PyTorch Lightning 1.5.10
PyTorch Lightning Bolts 0.5.0
ONNX 1.10.2
Keras 2.7.0
Magma 2.5.4
XGBoost 1.5.2
Transformers 4.11.3
Tokenizers 0.10.3
SentencePiece 0.1.96
Spacy 3.2.1
OpenCV 4.5.5
DALI 1.9.0
Horovod 0.23.0

Ascent: Software Installation/Default Software Changes (February 7-11, 2022)

Ascent’s operating system will be upgraded to Red Hat Enterprise Linux 8 (RHEL 8) on February 7-11, 2022.

Warning

Codes should be rebuilt prior to running following the upgrade due to the OS and software changes.

As a result of the upgrade, the following new packages will become available:

Package Current Default New Default
CUDA Toolkit 10.1.243 11.0.3
IBM Spectrum MPI 10.3.1.2-20200121 10.4.0.3-20210112
IBM XL 16.1.1-5 16.1.1-10
IBM ESSL 6.1.0-2 6.3.0

Note

The OS-provided Python will no longer be accessible as python (including variations like /usr/bin/python or /usr/bin/env python); rather, you must specify it as python2 or python3. If you are using python from one of the modulefiles rather than the version in /usr/bin, this change should not affect how you invoke python in your scripts, although we encourage specifying python2 or python3 as a best practice.


Summit: OpenCE 1.5.0 (December 29, 2021)

OpenCE 1.5.0 is now available on Summit. OpenCE 1.5.0 is available for python versions 3.7, 3.8, and 3.9. These builds can be accessed by loading the open-ce/1.5.0-py37-0, open-ce/1.5.0-py38-0, and open-ce/1.5.0-py39-0 modules, respectively.

The following packages are available in this release of OpenCE:

Package Version
Tensorflow 2.7.0
TensorFlow Estimators 2.7.0
TensorFlow Probability 0.15.0
TensorBoard 2.7.0
TensorFlow Text 2.7.0
TensorFlow Model Optimizations 0.7.0
TensorFlow Addons 0.15.0
TensorFlow Datasets 4.4.0
TensorFlow Hub 0.12.0
TensorFlow MetaData 1.0.0
PyTorch 1.10.0
TorchText 0.11.0
TorchVision 0.11.1
PyTorch Lightning 1.5.4
PyTorch Lightning Bolts 0.4.0
ONNX 1.10.2
Keras 2.7.0
Magma 2.5.4
XGBoost 1.5.1
Transformers 4.11.3
Tokenizers 0.10.3
SentencePiece 0.1.96
Spacy 3.2.0
Thinc 8.0.13
OpenCV 4.5.3
DALI 1.9.0
Horovod 0.23.0
Please note that Tensorflow Serving is currently unavailable. We are working with IBM to resolve the issue and will publish and update once available.

Andes: OS Upgrade (November 30, 2021)

On November 30, 2021, the Andes cluster will be upgraded to a newer (minor) version of the operating system. The table below summarizes the main changes. While recompiling is not required, it is recommended.

Component Old Version New Version
Red Hat Enterprise Linux 8.3 8.4
Mellanox InfiniBand Driver 5.3-1.0.0.1 5.4-1.0.3.0
NVIDIA driver 450.36.06 460.106.00-1
Slurm 20.02.6 20.02.7-1

Summit: OpenCE 1.4.0 (October 13, 2021)

OpenCE 1.4.0 is now available on Summit. OpenCE 1.4.0 is available for python versions 3.7, 3.8, and 3.9. These builds can be accessed by loading the open-ce/1.4.0-py37-0, open-ce/1.4.0-py38-0, and open-ce/1.4.0-py39-0 modules, respectively.

The following packages are available in this release of OpenCE:

Package Version
Tensorflow 2.6.0
TensorFlow Estimators 2.6.0
TensorFlow Probability 0.14.0
TensorBoard 2.6.0
TensorFlow Text 2.6.0
TensorFlow Model Optimizations 0.6.0
TensorFlow Addons 0.14.0
TensorFlow Datasets 4.4.0
TensorFlow Hub 0.12.0
TensorFlow MetaData 1.0.0
PyTorch 1.9.0
TorchText 0.10.0
TorchVision 0.10.0
PyTorch Lightning 1.4.4
PyTorch Lightning Bolts 0.3.4
ONNX 1.7.0
Keras 2.6.0
Magma 2.5.4
XGBoost 1.4.2
Transformers 4.9.2
Tokenizers 0.10.3
SentencePiece 0.1.91
Spacy 3.1.2
Thinc 8.0.8
OpenCV 3.4.14
Horovod 0.22.1
Please note that DALI and Tensorflow Serving are currently unavailable on ppc64le. We are working with IBM to resolve the issue and will publish and update once available.

Summit: Software Installation/Default Software Changes (August 17-19, 2021)

Summit’s operating system will be upgraded to Red Hat Enterprise Linux 8 (RHEL 8) on August 17-19, 2021.

Warning

Codes should be rebuilt prior to running following the upgrade due to the OS and software changes.

As a result of the upgrade, the following new packages will become available:

Package Current Default New Default
CUDA Toolkit 10.1.243 11.0.3
IBM Spectrum MPI 10.3.1.2-20200121 10.4.0.3-20210112
IBM XL 16.1.1-5 16.1.1-10
IBM ESSL 6.1.0-2 6.3.0

Note

The OS-provided Python will no longer be accessible as python (including variations like /usr/bin/python or /usr/bin/env python); rather, you must specify it as python2 or python3. If you are using python from one of the modulefiles rather than the version in /usr/bin, this change should not affect how you invoke python in your scripts, although we encourage specifying python2 or python3 as a best practice.

In addition, the following packages will be upgraded to newer versions and the specific versions listed below will be removed from the system. If you need any of the specific versions scheduled to be removed, please contact help@olcf.ornl.gov.

Package Versions Removed Versions Available
adios 1.11.1, 1.13.1 None
adios2 2.2.0, 2.4.0, 2.5.0 2.6.0
amgx 2.0.0.130.0, 2.0.0.130.1, 2.0.0.130.2 2.1.0-1
apr 1.6.2 1.7.0
apr-util 1.6.0 1.6.1
automake 1.16.1 1.16.2
binutils 2.31.1 2.33.1
bison 3.0.5 3.6.4
boost 1.59.0, 1.61.0, 1.66.0, 1.70.0 1.62.0, 1.72.0, 1.74.0
bzip2 1.0.6 1.0.8
c-blosc 1.12.1 1.17.0
cairo 1.14.12 1.16.0
ccache 3.7.9 3.7.11
cmake 3.11.3, 3.12.2, 3.13.4, 3.14.2, 3.15.2, 3.17.3, 3.18.1, 3.18.2, 3.6.1 3.18.4
cuda 9.1.85, 9.2.148, 10.1.105, 10.1.168, 10.1.243, 11.0.1, 11.0.2, 11.1.0 10.2.89, 11.0.3, 11.1.1
curl 7.60.0, 7.63.0 7.72.0
darshan-runtime 3.1.5-pre1, 3.1.6, 3.1.7 3.2.1
darshan-util 3.1.4, 3.1.5-pre1, 3.1.6, 3.1.7 3.2.1
emacs 25.1 27.1
essl 6.2.0-20190419 6.1.0-2, 6.2.1, 6.3.0
expat 2.2.5 2.2.10
flex 2.6.3 2.6.4
font-util 1.3.1 1.3.2
fontconfig 2.12.3 2.13.92
freetype 2.7.1, 2.9.1 2.10.1
gcc 4.8.5, 5.4.0, 6.4.0, 7.4.0, 8.1.0, 8.1.1, 9.1.0, 9.2.0, 10.1.0 8.3.1 (OS), 9.3.0, 10.2.0, 11.1.0
gdb 8.0, 8.2 9.2
gdbm 1.14.1 1.18.1
gdrcopy 2.0 2.1
gettext 0.19.8.1 0.21
git 2.13.0, 2.20.1, 2.9.3 2.29.0
git-lfs 2.8.0 None
glib 2.56.2, 2.56.3 2.66.2
gnupg 2.2.3 2.2.19
go 1.11.5 1.15.2
go-bootstrap 1.7.1-bootstrap None
gobject-introspection 1.49.2 1.56.1
gperf 3.0.4 3.1
gromacs 2020, 2020.2 2020.4
harfbuzz 1.4.6, 2.1.3 2.6.8
hdf5 1.10.3, 1.10.4, 1.8.18 1.10.7
help2man 1.47.4 1.47.11
hpx 1.3.0, 1.4.1 1.5.1
htop 2.0.2 3.0.2
hwloc 2.0.2 1.11.11, 2.2.0
hypre 2.11.1, 2.13.0, 2.15.1, develop 2.20.0
icu4c 58.2, 60.1 67.1
julia 1.4.2 1.5.2
kokkos 3.0.00 3.2.00
kokkos-nvcc-wrapper 20200221 3.2.00
libassuan 2.4.5 2.5.3
libbsd 0.8.6, 0.9.1 0.10.0
libevent 2.0.21 2.1.8
libfabric 1.7.0 1.11.0
libffi 3.2.1 3.3
libgcrypt 1.8.1 1.8.5
libgpg-error 1.27 1.37
libiconv 1.15 1.16
libjpeg-turbo 1.5.90 2.0.4
libksba 1.3.5 1.4.0
libpciaccess 0.13.5 0.16
libpng 1.6.34 1.6.37
libsigsegv 2.11 2.12
libsodium 1.0.15 1.0.18
libtiff 4.0.9 4.1.0
libunwind 1.2.1 1.4.0
libx11 1.6.5 1.6.7
libxext 1.3.3 None
libxml2 2.9.8 2.9.10
libxrender 0.9.10 None
libzmq (renamed from zeromq) 4.2.5 4.3.2
log4c 1.2.4 None
lz4 1.8.1.2 1.9.2
magma 2.1.0, 2.2.0, 2.3.0, 2.4.0, 2.5.1, 2.5.4 2.5.3
mercurial 3.9.1, 4.4.1 5.3
mpip 3.4.1, 3.4.1-1 3.5
mumps 5.0.1 5.3.3
nano 2.6.3 4.9
nasm 2.13.03 2.15.05
nco 4.6.9, 4.8.1, 4.9.1 4.9.3
ncurses 6.1 6.2
netcdf-c (renamed from netcdf) 4.6.1, 4.6.2 4.7.4
netcdf-cxx (renamed to netcdf-cxx4) 4.2 4.3.1
netcdf-fortran 4.4.4 4.4.5
netlib-scalapack 2.0.2 2.1.0
npth 1.5 1.6
numactl 2.0.11 2.0.14
openblas 0.3.5, 0.3.6, 0.3.9 0.3.12
open-ce 1.1.3 1.2.0
openmpi 4.0.3 4.0.5
papi 5.5.1, 5.6.0, 5.7.0 6.0.0.1
parallel-netcdf 1.8.0, 1.8.1 1.12.1
patchelf 0.9 0.10
pcre 8.42 8.44
perl 5.26.2 5.30.1
petsc 3.10.1, 3.10.3, 3.6.3, 3.6.4, 3.7.2 3.14.1
pgi 17.10, 17.9, 18.1, 18.10, 18.3, 18.4, 18.5, 18.7, 19.1, 19.10, 19.4, 19.5, 19.7, 19.9, 19.10 20.1, 20.4
pixman 0.34.0, 0.38.0 0.40.0
pkgconf (renamed from pkg-config) 1.4.2, 1.5.4 1.7.3
py-certifi 2017.1.23 2020.6.20
py-cython 0.28.3, 0.29 0.29.21
py-docutils 0.13.1 0.15.2
py-h5py 2.8.0 None
py-mpi4py 3.0.0 3.0.3
py-nose 1.3.7 None
py-numpy 1.15.1 1.19.4
py-pip 10.0.1 None
py-pkgconfig 1.2.2 None
py-pygments 2.2.0 2.6.1
py-setuptools 40.2.0, 40.4.3 50.3.2
py-six 1.11.0 None
py-virtualenv 16.0.0 None
python 2.7.15-anaconda2-5.3.0, 3.6.6-anaconda3-5.3.0, 3.7.0-anaconda3-5.3.0, 2.7.12, 3.5.2, 3.7.0 2.7.15, 3.7.7, 3.8.6
r 3.5.2 4.0.5
raja 0.1.0 0.12.1
rdma-core 20 32.0
readline 6.3, 7.0 8.0
renderproto 0.11.1 None
scons 3.0.1 3.1.2
screen 4.3.1 4.8.0
snappy 1.1.7 1.1.8
spectral 20181227, 20190401, 20200714, 20200903 20210514
spectrum-mpi 10.2.0.10-20181214, 10.2.0.11-20190201, 10.2.0.7-20180830, 10.3.0.0-20190419, 10.3.0.1-20190611, 10.3.1.2-20200121 10.4.0.3-20210112
sqlite 3.23.1, 3.26.0 3.33.0
subversion 1.9.3 1.14.0
superlu-dist 4.3, 5.1.3, 5.4.0 6.4.0
sz 1.4.10.0, 1.4.12.3 2.0.2.0, 2.1.11
tar 1.30, 1.31 1.32
tcl 8.6.8 None
tk 8.6.8 None
tmux 2.2 3.1b
ucx 1.7.0 None
udunits (renamed from udunits2) 2.2.24 None
valgrind 3.11.0, 3.14.0 3.15.0
vim 7.4.2367, 8.1.0338 8.2.1201
xl 16.1.1-4, 16.1.1-5, 16.1.1-6, 16.1.1-7, 16.1.1-9 16.1.1-8, 16.1.1-10
xz 5.2.4 5.2.5
zfp 0.5.0, 0.5.2 0.5.5
zstd 1.3.0 1.4.5

Summit: Software Installation/Default Software Changes (April 7, 2021)

The following modules were installed as default on April 7, 2021.

Package Current Default New Default
open-ce 0.1-0 1.1.3-py38-0

In addition, open-ce 1.1.3 is also available for python versions 3.6 and 3.7. These builds can be accessed by loading the open-ce/1.1.3-py36-0 and open-ce/1.1.3-py37-0 modules, respectively.

The following packages are available in this release of open-ce.

Package Version
Tensorflow 2.4.1
TensorFlow Serving 2.4.1
TensorFlow Estimators 2.4.0
TensorFlow Probability 0.12.1
TensorBoard 2.4.1
TensorFlow Text 2.4.1
TensorFlow Model Optimizations 0.5.0
TensorFlow Addons 0.11.2
TensorFlow Datasets 4.1.0
TensorFlow Hub 0.10.0
TensorFlow MetaData 0.26.0
PyTorch 1.7.1
TorchText 0.8.1
TorchVision 0.8.2
PyTorch Lightning 1.1.0
PyTorch Lightning Bolts 0.2.5
XGBoost 1.3.3
Transformers 3.5.1
Tokenizers 0.9.3
SentencePiece 0.1.91
Spacy 2.3.4
Thinc 7.4.1
DALI 0.28.0
OpenCV 3.4.10
Horovod 0.21.0

Summit: Software Installation/Default Software Changes (April 8, 2020)

The following modules were installed as default on April 8, 2020.

Package Current Default New Default
ibm-wml-ce 1.7.0-1 1.7.0-2

The new IBM Watson Machine Learning (WML) Community Edition (CE) install adds improvements to DDL including support for jsrun.


Summit: Software Installation/Default Software Changes (March 10, 2020)

The following modules will be installed as default on March 10, 2020. The new stack requires the latest version of Spectrum MPI and as a result, previous versions have been deprecated.

Package Current Default New Default
cuda 10.1.168 10.1.243
spectrum-mpi 10.3.0.1-20190611 10.3.1.2-20200121
hdf5 1.10.3 1.10.4
pgi 19.4 19.9
xl 16.1.1-3 16.1.1-5
ibm-wml-ce 1.6.2-3 1.7.0-1

In addition, the following new packages have been installed and are available for use:

Package New Version
pgi 20.1
xl 16.1.1-6
kokkos 3.0.0

Finally, the FFTW installations on Summit for the XL compiler have been rebuilt using -O2 to address an issue observed when running the FFTW suite using the default optimization options. All builds of the fftw package that use the XL compiler have been rebuilt.

If you encounter any issues, please contact help@olcf.ornl.gov.


Rhea: OpenMPI Upgrade (February 18, 2020)

On February 18, 2020, Rhea’s default OpenMPI will be updated to version 3.1.4. Due to underlying library changes that will be made on the same day, following the change, all codes should be rebuilt against the updated version.

Package Current Default New Default
OpenMPI 3.1.3 3.1.4

All Systems: Python2 End of Life (January 01, 2020)

On January 1, 2020, Python 2 will reach its end of life and will no longer be supported by the project’s core developers. On this date, the OLCF will also end its support for Python 2. Users reliant on Python 2 should port code to Python 3 for forward compatibility with OLCF systems and many open source packages. Python 2 modules will not be removed on January 1, but will no longer receive maintenance or regular updates.

While default Python modules on OLCF systems are already set to Python 3, we recommend all users follow PEP394 by explicitly invoking either ‘python2’ or ‘python3’ instead of simply ‘python’. Python 2 Conda Environments and user installations of Python 2 will remain as options for using Python 2 on OLCF systems.

Official documentation for porting from Python 2 to Python3 can be found at: https://docs.python.org/3/howto/pyporting.html

General information and a list of open source packages dropping support for Python 2 can be found at: https://python3statement.org/


Summit: Software Upgrade (July 16, 2019)

The following modules will be installed and will become the default on July 16, 2019. The new stack requires Spectrum MPI 10.3 PTF 1 and as a result previous versions of Spectrum MPI have been deprecated.

Package Default
cuda 10.1.168
spectrum-mpi 10.3.0.1-20190716

Details about the software stack upgrade can be found in the IBM Service Pack 3.1 site and the Spectrum MPI 10.3.0.1 release notes.


Summit: Software Installation/Default Software Changes (May 21, 2019)

The following modules will be installed as default on May 21, 2019. The new stack requires Spectrum MPI 10.3 and as a result previous versions of Spectrum MPI have been deprecated.

Package Default
xl 16.1.1.3
cuda 10.1.105
essl 6.2.0-20190419
spectrum-mpi 10.3.0.0-20190419

Rhea: Default Software Changes (March 12, 2019)

The following modules will become the default on March 12, 2019.

Package Default
intel 19.0.0
pgi 18.10
gcc 6.2.0
cuda 10.0.3
openmpi 3.1.3
anaconda 5.3.0
adios 1.11.1
atlas 3.10.2
boost 1.67.0
fftw 3.3.8
hdf5 1.10.3
nco 4.6.9
netcdf 4.6.1
netcdf-fortran 4.4.4
netcdf-cxx 4.3.0
parallel-netcdf 1.8.0

Summit: Default Software Changes (March 12, 2019)

The following modules will become the default on March 12, 2019.

Package Current Default New Default
spectrum-mpi unset 10.2.0.11-20190201
xl 16.1.1-1 16.1.1-2
pgi unset 18.10

In addition, the following default Spectrum MPI settings will be changed to address issues resolved with the February 19, 2019 software upgrade:

Environment Variable Current Default New Default
OMP_MCA_io romio314 romio321
OMPI_MCA_coll_ibm_xml_disable_cache 1 unset
PAMI_PMIX_USE_OLD_MAPCACHE 1 unset