Software News

This page lists significant changes to software provided on OLCF systems. The most recent changes are listed first.


Summit: System Software Upgrade (January 24, 2024)

The Summit system was upgraded to a new version of the system software stack.

Warning

Codes should be rebuilt prior to running following the upgrade due to the OS and software changes.

As a result of the upgrade, the following new packages are now default:

Package

Previous Default

New Default

CUDA Toolkit

11.0.3

11.7.1

IBM Spectrum MPI

10.4.0.3-20210112

10.4.0.6-20230210

IBM XL

16.1.1-10

16.1.1-13

GCC

9.1.0

12.1.0

Please note the previous software stack remains available and can be accessed by loading the DefApps-2023 modulefile. For convenience, a DefApps-2024 is also provide to restore the most recent version of packages. From the DefApps-2023 environment, users can load the DefApps-2024 modulefile or start a fresh login to reset the environment to the latest versions.

In addition, OpenCE 1.10 is now available for Python 3.9 and 3.11. OpenCE 1.10 is available by loading the open-ce/1.10.0-py39-ibm or open-ce/1.10.0-py311-ibm modulefiles. Please note that each environment includes a differesent set of Python packages as outlined below.

Python 3.9 Package

Version

pytorch

2.0.1

pytorch-lightning

2.0.1

pytorch-lightning-bolts

0.6.0

torchdata

0.4.1

torchmetrics

0.11.4

torchvision

0.15.2

torchvision-base

0.15.2

sentencepiece

0.1.97

horovod

0.28.0

Python 3.11 Package

Version

tensorboard

2.13.0

tensorflow

2.13.0

tensorflow-datasets

4.9.2

tensorflow-estimator

2.13.0

tensorflow-hub

0.14.0

tensorflow-metadata

1.13.1

tensorflow-model-optimization

0.7.5

tensorflow-probability

0.20.0

tensorflow-text

2.13.0

pytorch

2.0.1

pytorch-base

2.0.1

pytorch-lightning

2.0.9

pytorch-lightning-bolts

0.7.0

torchtext

0.15.2

torchvision

0.15.2

onnx

1.14.0

keras

2.13.1

xgboost

1.7.6

tokenizers

0.15.0

transformers

4.37.0

sentencepiece

0.1.97

horovod

0.28.0

dali

1.28.0

opencv

4.8.0

Please contact help@olcf.ornl.gov if you encounter any issues or have questions.


Frontier and Crusher: System Software Upgrade (January 23, 2024)

The Crusher TDS and Frontier systems were upgraded to a new version of the system software stack. This stack introduces ROCm 6.0.0 and HPE/Cray Programming Environment 23.12. For more information, please see:

Please contact help@olcf.ornl.gov with any issues or questions.


Frontier and Crusher: System Software Upgrade (July 18, 2023)

The Crusher TDS and Frontier systems were upgraded to a new version of the system software stack. This stack introduces ROCm 5.5.1 and HPE/Cray Programming Environment 23.05. For more information, please see:

Please contact help@olcf.ornl.gov with any issues or questions.


Frontier: Darshan Runtime 3.4.0 (May 10, 2023)

The Darshan Runtime modulefile darshan-runtime/3.4.0 on Frontier is now loaded by default. This module will allow users to profile the I/O of their applications with minimal impact. The logs are available to users on the Orion file system in /lustre/orion/darshan/<system>/<yyyy>/<mm>/<dd>.

Unloading darshan-runtime modulefile is recommended for users profiling their applications with other profilers to prevent conflicts.

Please make a note of this change and contact help@olcf.ornl.gov with any issues or questions.

Package

Version

darshan-runtime

3.4.0


Summit: Darshan Runtime 3.4.0-lite (December 28, 2022)

The default version of Darshan Runtime has been updated on Summit to version 3.4.0-lite and is available via the darshan-runtime/3.4.0-lite modulefile. In addition, the default version for the companion set of tools provided in Darshan Util has been updated to darshan-util/3.4.0. Please note that darshan-util/3.4.0 is required to properly parse logs generated with darshan-runtime/3.4.0-lite.

Package

Version

darshan-runtime

3.4.0-lite


Summit: OpenCE 1.5.2 (March 17, 2022)

OpenCE 1.5.2 is now available on Summit. OpenCE 1.5.2 is available for python versions 3.9, 3.8, and 3.7. These builds can be accessed by loading the open-ce/1.5.2-py39-0, open-ce/1.5.2-py38-0, and open-ce/1.5.2-py37-0 modules, respectively.

The following packages are available in this release of OpenCE:

Package

Version

Tensorflow

2.7.1

TensorFlow Estimators

2.7.0

TensorFlow Probability

0.15.0

TensorBoard

2.7.0

TensorFlow Text

2.7.3

TensorFlow Model Optimizations

0.7.0

TensorFlow Addons

0.15.0

TensorFlow Datasets

4.4.0

TensorFlow Hub

0.12.0

TensorFlow MetaData

1.5.0

PyTorch

1.10.2

TorchText

0.11.2

TorchVision

0.11.3

PyTorch Lightning

1.5.10

PyTorch Lightning Bolts

0.5.0

ONNX

1.10.2

Keras

2.7.0

Magma

2.5.4

XGBoost

1.5.2

Transformers

4.11.3

Tokenizers

0.10.3

SentencePiece

0.1.96

Spacy

3.2.1

OpenCV

4.5.5

DALI

1.9.0

Horovod

0.23.0


Ascent: Software Installation/Default Software Changes (February 7-11, 2022)

Ascent’s operating system will be upgraded to Red Hat Enterprise Linux 8 (RHEL 8) on February 7-11, 2022.

Warning

Codes should be rebuilt prior to running following the upgrade due to the OS and software changes.

As a result of the upgrade, the following new packages will become available:

Package

Current Default

New Default

CUDA Toolkit

10.1.243

11.0.3

IBM Spectrum MPI

10.3.1.2-20200121

10.4.0.3-20210112

IBM XL

16.1.1-5

16.1.1-10

IBM ESSL

6.1.0-2

6.3.0

Note

The OS-provided Python will no longer be accessible as python (including variations like /usr/bin/python or /usr/bin/env python); rather, you must specify it as python2 or python3. If you are using python from one of the modulefiles rather than the version in /usr/bin, this change should not affect how you invoke python in your scripts, although we encourage specifying python2 or python3 as a best practice.


Summit: OpenCE 1.5.0 (December 29, 2021)

OpenCE 1.5.0 is now available on Summit. OpenCE 1.5.0 is available for python versions 3.7, 3.8, and 3.9. These builds can be accessed by loading the open-ce/1.5.0-py37-0, open-ce/1.5.0-py38-0, and open-ce/1.5.0-py39-0 modules, respectively.

The following packages are available in this release of OpenCE:

Package

Version

Tensorflow

2.7.0

TensorFlow Estimators

2.7.0

TensorFlow Probability

0.15.0

TensorBoard

2.7.0

TensorFlow Text

2.7.0

TensorFlow Model Optimizations

0.7.0

TensorFlow Addons

0.15.0

TensorFlow Datasets

4.4.0

TensorFlow Hub

0.12.0

TensorFlow MetaData

1.0.0

PyTorch

1.10.0

TorchText

0.11.0

TorchVision

0.11.1

PyTorch Lightning

1.5.4

PyTorch Lightning Bolts

0.4.0

ONNX

1.10.2

Keras

2.7.0

Magma

2.5.4

XGBoost

1.5.1

Transformers

4.11.3

Tokenizers

0.10.3

SentencePiece

0.1.96

Spacy

3.2.0

Thinc

8.0.13

OpenCV

4.5.3

DALI

1.9.0

Horovod

0.23.0

Please note that Tensorflow Serving is currently unavailable. We are working with IBM to resolve the issue and will publish and update once available.

Andes: OS Upgrade (November 30, 2021)

On November 30, 2021, the Andes cluster will be upgraded to a newer (minor) version of the operating system. The table below summarizes the main changes. While recompiling is not required, it is recommended.

Component

Old Version

New Version

Red Hat Enterprise Linux

8.3

8.4

Mellanox InfiniBand Driver

5.3-1.0.0.1

5.4-1.0.3.0

NVIDIA driver

450.36.06

460.106.00-1

Slurm

20.02.6

20.02.7-1


Summit: OpenCE 1.4.0 (October 13, 2021)

OpenCE 1.4.0 is now available on Summit. OpenCE 1.4.0 is available for python versions 3.7, 3.8, and 3.9. These builds can be accessed by loading the open-ce/1.4.0-py37-0, open-ce/1.4.0-py38-0, and open-ce/1.4.0-py39-0 modules, respectively.

The following packages are available in this release of OpenCE:

Package

Version

Tensorflow

2.6.0

TensorFlow Estimators

2.6.0

TensorFlow Probability

0.14.0

TensorBoard

2.6.0

TensorFlow Text

2.6.0

TensorFlow Model Optimizations

0.6.0

TensorFlow Addons

0.14.0

TensorFlow Datasets

4.4.0

TensorFlow Hub

0.12.0

TensorFlow MetaData

1.0.0

PyTorch

1.9.0

TorchText

0.10.0

TorchVision

0.10.0

PyTorch Lightning

1.4.4

PyTorch Lightning Bolts

0.3.4

ONNX

1.7.0

Keras

2.6.0

Magma

2.5.4

XGBoost

1.4.2

Transformers

4.9.2

Tokenizers

0.10.3

SentencePiece

0.1.91

Spacy

3.1.2

Thinc

8.0.8

OpenCV

3.4.14

Horovod

0.22.1

Please note that DALI and Tensorflow Serving are currently unavailable on ppc64le. We are working with IBM to resolve the issue and will publish and update once available.

Summit: Software Installation/Default Software Changes (August 17-19, 2021)

Summit’s operating system will be upgraded to Red Hat Enterprise Linux 8 (RHEL 8) on August 17-19, 2021.

Warning

Codes should be rebuilt prior to running following the upgrade due to the OS and software changes.

As a result of the upgrade, the following new packages will become available:

Package

Current Default

New Default

CUDA Toolkit

10.1.243

11.0.3

IBM Spectrum MPI

10.3.1.2-20200121

10.4.0.3-20210112

IBM XL

16.1.1-5

16.1.1-10

IBM ESSL

6.1.0-2

6.3.0

Note

The OS-provided Python will no longer be accessible as python (including variations like /usr/bin/python or /usr/bin/env python); rather, you must specify it as python2 or python3. If you are using python from one of the modulefiles rather than the version in /usr/bin, this change should not affect how you invoke python in your scripts, although we encourage specifying python2 or python3 as a best practice.

In addition, the following packages will be upgraded to newer versions and the specific versions listed below will be removed from the system. If you need any of the specific versions scheduled to be removed, please contact help@olcf.ornl.gov.

Package

Versions Removed

Versions Available

adios

1.11.1, 1.13.1

None

adios2

2.2.0, 2.4.0, 2.5.0

2.6.0

amgx

2.0.0.130.0, 2.0.0.130.1, 2.0.0.130.2

2.1.0-1

apr

1.6.2

1.7.0

apr-util

1.6.0

1.6.1

automake

1.16.1

1.16.2

binutils

2.31.1

2.33.1

bison

3.0.5

3.6.4

boost

1.59.0, 1.61.0, 1.66.0, 1.70.0

1.62.0, 1.72.0, 1.74.0

bzip2

1.0.6

1.0.8

c-blosc

1.12.1

1.17.0

cairo

1.14.12

1.16.0

ccache

3.7.9

3.7.11

cmake

3.11.3, 3.12.2, 3.13.4, 3.14.2, 3.15.2, 3.17.3, 3.18.1, 3.18.2, 3.6.1

3.18.4

cuda

9.1.85, 9.2.148, 10.1.105, 10.1.168, 10.1.243, 11.0.1, 11.0.2, 11.1.0

10.2.89, 11.0.3, 11.1.1

curl

7.60.0, 7.63.0

7.72.0

darshan-runtime

3.1.5-pre1, 3.1.6, 3.1.7

3.2.1

darshan-util

3.1.4, 3.1.5-pre1, 3.1.6, 3.1.7

3.2.1

emacs

25.1

27.1

essl

6.2.0-20190419

6.1.0-2, 6.2.1, 6.3.0

expat

2.2.5

2.2.10

flex

2.6.3

2.6.4

font-util

1.3.1

1.3.2

fontconfig

2.12.3

2.13.92

freetype

2.7.1, 2.9.1

2.10.1

gcc

4.8.5, 5.4.0, 6.4.0, 7.4.0, 8.1.0, 8.1.1, 9.1.0, 9.2.0, 10.1.0

8.3.1 (OS), 9.3.0, 10.2.0, 11.1.0

gdb

8.0, 8.2

9.2

gdbm

1.14.1

1.18.1

gdrcopy

2.0

2.1

gettext

0.19.8.1

0.21

git

2.13.0, 2.20.1, 2.9.3

2.29.0

git-lfs

2.8.0

None

glib

2.56.2, 2.56.3

2.66.2

gnupg

2.2.3

2.2.19

go

1.11.5

1.15.2

go-bootstrap

1.7.1-bootstrap

None

gobject-introspection

1.49.2

1.56.1

gperf

3.0.4

3.1

gromacs

2020, 2020.2

2020.4

harfbuzz

1.4.6, 2.1.3

2.6.8

hdf5

1.10.3, 1.10.4, 1.8.18

1.10.7

help2man

1.47.4

1.47.11

hpx

1.3.0, 1.4.1

1.5.1

htop

2.0.2

3.0.2

hwloc

2.0.2

1.11.11, 2.2.0

hypre

2.11.1, 2.13.0, 2.15.1, develop

2.20.0

icu4c

58.2, 60.1

67.1

julia

1.4.2

1.5.2

kokkos

3.0.00

3.2.00

kokkos-nvcc-wrapper

20200221

3.2.00

libassuan

2.4.5

2.5.3

libbsd

0.8.6, 0.9.1

0.10.0

libevent

2.0.21

2.1.8

libfabric

1.7.0

1.11.0

libffi

3.2.1

3.3

libgcrypt

1.8.1

1.8.5

libgpg-error

1.27

1.37

libiconv

1.15

1.16

libjpeg-turbo

1.5.90

2.0.4

libksba

1.3.5

1.4.0

libpciaccess

0.13.5

0.16

libpng

1.6.34

1.6.37

libsigsegv

2.11

2.12

libsodium

1.0.15

1.0.18

libtiff

4.0.9

4.1.0

libunwind

1.2.1

1.4.0

libx11

1.6.5

1.6.7

libxext

1.3.3

None

libxml2

2.9.8

2.9.10

libxrender

0.9.10

None

libzmq (renamed from zeromq)

4.2.5

4.3.2

log4c

1.2.4

None

lz4

1.8.1.2

1.9.2

magma

2.1.0, 2.2.0, 2.3.0, 2.4.0, 2.5.1, 2.5.4

2.5.3

mercurial

3.9.1, 4.4.1

5.3

mpip

3.4.1, 3.4.1-1

3.5

mumps

5.0.1

5.3.3

nano

2.6.3

4.9

nasm

2.13.03

2.15.05

nco

4.6.9, 4.8.1, 4.9.1

4.9.3

ncurses

6.1

6.2

netcdf-c (renamed from netcdf)

4.6.1, 4.6.2

4.7.4

netcdf-cxx (renamed to netcdf-cxx4)

4.2

4.3.1

netcdf-fortran

4.4.4

4.4.5

netlib-scalapack

2.0.2

2.1.0

npth

1.5

1.6

numactl

2.0.11

2.0.14

openblas

0.3.5, 0.3.6, 0.3.9

0.3.12

open-ce

1.1.3

1.2.0

openmpi

4.0.3

4.0.5

papi

5.5.1, 5.6.0, 5.7.0

6.0.0.1

parallel-netcdf

1.8.0, 1.8.1

1.12.1

patchelf

0.9

0.10

pcre

8.42

8.44

perl

5.26.2

5.30.1

petsc

3.10.1, 3.10.3, 3.6.3, 3.6.4, 3.7.2

3.14.1

pgi

17.10, 17.9, 18.1, 18.10, 18.3, 18.4, 18.5, 18.7, 19.1, 19.10, 19.4, 19.5, 19.7, 19.9, 19.10

20.1, 20.4

pixman

0.34.0, 0.38.0

0.40.0

pkgconf (renamed from pkg-config)

1.4.2, 1.5.4

1.7.3

py-certifi

2017.1.23

2020.6.20

py-cython

0.28.3, 0.29

0.29.21

py-docutils

0.13.1

0.15.2

py-h5py

2.8.0

None

py-mpi4py

3.0.0

3.0.3

py-nose

1.3.7

None

py-numpy

1.15.1

1.19.4

py-pip

10.0.1

None

py-pkgconfig

1.2.2

None

py-pygments

2.2.0

2.6.1

py-setuptools

40.2.0, 40.4.3

50.3.2

py-six

1.11.0

None

py-virtualenv

16.0.0

None

python

2.7.15-anaconda2-5.3.0, 3.6.6-anaconda3-5.3.0, 3.7.0-anaconda3-5.3.0, 2.7.12, 3.5.2, 3.7.0

2.7.15, 3.7.7, 3.8.6

r

3.5.2

4.0.5

raja

0.1.0

0.12.1

rdma-core

20

32.0

readline

6.3, 7.0

8.0

renderproto

0.11.1

None

scons

3.0.1

3.1.2

screen

4.3.1

4.8.0

snappy

1.1.7

1.1.8

spectral

20181227, 20190401, 20200714, 20200903

20210514

spectrum-mpi

10.2.0.10-20181214, 10.2.0.11-20190201, 10.2.0.7-20180830, 10.3.0.0-20190419, 10.3.0.1-20190611, 10.3.1.2-20200121

10.4.0.3-20210112

sqlite

3.23.1, 3.26.0

3.33.0

subversion

1.9.3

1.14.0

superlu-dist

4.3, 5.1.3, 5.4.0

6.4.0

sz

1.4.10.0, 1.4.12.3

2.0.2.0, 2.1.11

tar

1.30, 1.31

1.32

tcl

8.6.8

None

tk

8.6.8

None

tmux

2.2

3.1b

ucx

1.7.0

None

udunits (renamed from udunits2)

2.2.24

None

valgrind

3.11.0, 3.14.0

3.15.0

vim

7.4.2367, 8.1.0338

8.2.1201

xl

16.1.1-4, 16.1.1-5, 16.1.1-6, 16.1.1-7, 16.1.1-9

16.1.1-8, 16.1.1-10

xz

5.2.4

5.2.5

zfp

0.5.0, 0.5.2

0.5.5

zstd

1.3.0

1.4.5


Summit: Software Installation/Default Software Changes (April 7, 2021)

The following modules were installed as default on April 7, 2021.

Package

Current Default

New Default

open-ce

0.1-0

1.1.3-py38-0

In addition, open-ce 1.1.3 is also available for python versions 3.6 and 3.7. These builds can be accessed by loading the open-ce/1.1.3-py36-0 and open-ce/1.1.3-py37-0 modules, respectively.

The following packages are available in this release of open-ce.

Package

Version

Tensorflow

2.4.1

TensorFlow Serving

2.4.1

TensorFlow Estimators

2.4.0

TensorFlow Probability

0.12.1

TensorBoard

2.4.1

TensorFlow Text

2.4.1

TensorFlow Model Optimizations

0.5.0

TensorFlow Addons

0.11.2

TensorFlow Datasets

4.1.0

TensorFlow Hub

0.10.0

TensorFlow MetaData

0.26.0

PyTorch

1.7.1

TorchText

0.8.1

TorchVision

0.8.2

PyTorch Lightning

1.1.0

PyTorch Lightning Bolts

0.2.5

XGBoost

1.3.3

Transformers

3.5.1

Tokenizers

0.9.3

SentencePiece

0.1.91

Spacy

2.3.4

Thinc

7.4.1

DALI

0.28.0

OpenCV

3.4.10

Horovod

0.21.0


Summit: Software Installation/Default Software Changes (April 8, 2020)

The following modules were installed as default on April 8, 2020.

Package

Current Default

New Default

ibm-wml-ce

1.7.0-1

1.7.0-2

The new IBM Watson Machine Learning (WML) Community Edition (CE) install adds improvements to DDL including support for jsrun.


Summit: Software Installation/Default Software Changes (March 10, 2020)

The following modules will be installed as default on March 10, 2020. The new stack requires the latest version of Spectrum MPI and as a result, previous versions have been deprecated.

Package

Current Default

New Default

cuda

10.1.168

10.1.243

spectrum-mpi

10.3.0.1-20190611

10.3.1.2-20200121

hdf5

1.10.3

1.10.4

pgi

19.4

19.9

xl

16.1.1-3

16.1.1-5

ibm-wml-ce

1.6.2-3

1.7.0-1

In addition, the following new packages have been installed and are available for use:

Package

New Version

pgi

20.1

xl

16.1.1-6

kokkos

3.0.0

Finally, the FFTW installations on Summit for the XL compiler have been rebuilt using -O2 to address an issue observed when running the FFTW suite using the default optimization options. All builds of the fftw package that use the XL compiler have been rebuilt.

If you encounter any issues, please contact help@olcf.ornl.gov.


Rhea: OpenMPI Upgrade (February 18, 2020)

On February 18, 2020, Rhea’s default OpenMPI will be updated to version 3.1.4. Due to underlying library changes that will be made on the same day, following the change, all codes should be rebuilt against the updated version.

Package

Current Default

New Default

OpenMPI

3.1.3

3.1.4


All Systems: Python2 End of Life (January 01, 2020)

On January 1, 2020, Python 2 will reach its end of life and will no longer be supported by the project’s core developers. On this date, the OLCF will also end its support for Python 2. Users reliant on Python 2 should port code to Python 3 for forward compatibility with OLCF systems and many open source packages. Python 2 modules will not be removed on January 1, but will no longer receive maintenance or regular updates.

While default Python modules on OLCF systems are already set to Python 3, we recommend all users follow PEP394 by explicitly invoking either ‘python2’ or ‘python3’ instead of simply ‘python’. Python 2 Conda Environments and user installations of Python 2 will remain as options for using Python 2 on OLCF systems.

Official documentation for porting from Python 2 to Python3 can be found at: https://docs.python.org/3/howto/pyporting.html

General information and a list of open source packages dropping support for Python 2 can be found at: https://python3statement.org/


Summit: Software Upgrade (July 16, 2019)

The following modules will be installed and will become the default on July 16, 2019. The new stack requires Spectrum MPI 10.3 PTF 1 and as a result previous versions of Spectrum MPI have been deprecated.

Package

Default

cuda

10.1.168

spectrum-mpi

10.3.0.1-20190716

Details about the software stack upgrade can be found in the IBM Service Pack 3.1 site and the Spectrum MPI 10.3.0.1 release notes.


Summit: Software Installation/Default Software Changes (May 21, 2019)

The following modules will be installed as default on May 21, 2019. The new stack requires Spectrum MPI 10.3 and as a result previous versions of Spectrum MPI have been deprecated.

Package

Default

xl

16.1.1.3

cuda

10.1.105

essl

6.2.0-20190419

spectrum-mpi

10.3.0.0-20190419


Rhea: Default Software Changes (March 12, 2019)

The following modules will become the default on March 12, 2019.

Package

Default

intel

19.0.0

pgi

18.10

gcc

6.2.0

cuda

10.0.3

openmpi

3.1.3

anaconda

5.3.0

adios

1.11.1

atlas

3.10.2

boost

1.67.0

fftw

3.3.8

hdf5

1.10.3

nco

4.6.9

netcdf

4.6.1

netcdf-fortran

4.4.4

netcdf-cxx

4.3.0

parallel-netcdf

1.8.0


Summit: Default Software Changes (March 12, 2019)

The following modules will become the default on March 12, 2019.

Package

Current Default

New Default

spectrum-mpi

unset

10.2.0.11-20190201

xl

16.1.1-1

16.1.1-2

pgi

unset

18.10

In addition, the following default Spectrum MPI settings will be changed to address issues resolved with the February 19, 2019 software upgrade:

Environment Variable

Current Default

New Default

OMP_MCA_io

romio314

romio321

OMPI_MCA_coll_ibm_xml_disable_cache

1

unset

PAMI_PMIX_USE_OLD_MAPCACHE

1

unset