-
Notifications
You must be signed in to change notification settings - Fork 144
Conference call notes 20221123
Kenneth Hoste edited this page Dec 6, 2022
·
8 revisions
(back to Conference calls)
Notes on the 210th EasyBuild conference call, Wednesday 23 November 2022 (16:00 UTC)
List of attendees (19):
- Sebastian Achilles (J ülich Supercomputing Centre, Germany)
- Maxime Boissonneault (Digital Research Alliance of Canada)
- Simon Branford (Univ. of Birmingham, UK)
- Jordi Camps (CNAG-CRG, Spain)
- John Dey (Fred Hutch, Seattle, US)
- Alex Domingo (Vrije Universiteit Brussel, Belgium)
- Em Dragowsky (Case Western Reserve University, Ohio, US)
- Fotis Georgatos (EPFL, Switzerland)
- Jasper Grimm (University of York, UK)
- Thomas Hayward-Schneider (Max Planck Institute for Plasma Physics, Germany)
- Kenneth Hoste (HPC-UGent)
- Adam Huffman (Big Data Institute, Oxford, UK)
- Sebastien Moretti (SIB, Switzerland)
- Alan O'Cais (CECAM, Switzerland)
- Mikael Öhman (Chalmers University of Technology, Sweden)
- Bart Oldeman (Digital Research Alliance of Canada)
- Umashankar Sivakumar (AMD)
- Caspar van Leeuwen (SURF, Netherlands)
- Lars Viklund (Umeå University, Sweden)
- overview of recent developments + outlook to next EasyBuild release
- update on porting of EasyBuild docs to MarkDown
- 2022b common toolchain
- Q&A
- release timeline
- latest release: EasyBuild v4.6.2 (21 Oct 2022)
- ETA next release (EasyBuild v4.7.0): by mid Dec'22
- recent changes
-
framework
- bug fixes
-
enhancements
- add support for checksums specified in external
checksums.json
file (PR #3749)- should we adopt the use of this in the central easyconfigs repo?
- complications:
- dealing with merge conflicts in easyconfig PRs...
-
--new-pr
and/or--merge-pr
would need to be made a bit more intelligent - Bart: there's some analogy with Gentoo manifest files here
-
--new-pr
should also have support for including achecksums.json
into a PR
- take into account custom configuration options specified in easystack file (PR #4057)
- add support for checksums specified in external
-
changes
- drop support for easystack files using '
software
' top-level key (PR #4057)
- drop support for easystack files using '
-
easyblocks
-
bug fixes
- ...
-
enhancements
- add extra option in ESMF easyblock for disabling LAPACK (PR #2821)
- updates
-
changes
- ...
- new software
-
bug fixes
-
easyconfigs
-
~100 easyconfig PRs were merged since last conf call
-
26 PRs merged PRs related to BioHackathon
- target was to get specific pipeline to work: https://github.com/easybuilders/easybuild-easyconfigs/pull/16613/files
-
26 PRs merged PRs related to BioHackathon
-
bug fixes
- define
$GTKDOCIZE
as'echo'
before generating configure script for recent HarfBuzz versions (PR #16570) - use '
cpan.metacpan.org
' rather than 'www.cpan.org
' in extension source_urls for recent Perl easyconfigs (PR #16611) - avoid that zlib + htslib are downloaded and built during installation of MetaBAT (PR #16624)
- add patch to fix installation of MetaBAT 2.15 on non-x86_64 systems (PR #16633)
- add missing pyWannier90 dependency for mcu + enhance sanity check (PR #16667)
- fix checksum for dlllogger extension in OpenFold v1.0.0 (PR #16694)
- stick to older PyQt-builder in easyconfig for PyQt5 5.15.5, so that 'pip check' passes (PR #16703)
- build
nodejs
with OpenSSL and ICU provided as proper dependencies (PR #16529)
- define
-
enhancements
- ...
-
(noteworthy) new software
- see also overview at https://github.com/easybuilders/easybuild-easyconfigs/issues?q=is%3Amerged+label%3Anew
- OmegaFold (PR #16698)
-
noteworthy software updates
- ...
- changes
- ...
-
~100 easyconfig PRs were merged since last conf call
-
framework
- work in progress
-
framework
-
reported bugs / bug fixes
-
sanity_check_rpath
should not check forlibcuda.so.1
(PR #4095)
-
-
enhancements
- add
easybuild.tools.LooseVersion
(sincedistutils
is deprecated in Python 3.10) (PR #3794) - add support for AOCC compiler + AMD FFTW library and definitions for amd, aocc, aompi toolchains (PR #4058)
- add Arch Linux compatibility for OS dependency resolution (PR #4116)
- add support for
--filter-rpath-sanity-libs
to skip RPATH sanity check for designated libraries (PR #4119) - add
sanity_check_load_module
method toEasyBlock
to provide control over when module is loaded during sanity check step (PR #4125) - verify that the compilers supposed to be used actually work (issue #4124)
- add
-
changes
- also run unit tests with Python 3.11 (WIP) (PR #4092)
-
reported bugs / bug fixes
-
easyblocks
- bug reports/fixes
- create
$XDG_CACHE_HOME
for PyTorch tests (PR #2806) - load module early during PythonPackage's sanity check step via sanity_check_load_module (PR #2828)
- to fix
--sanity-check-only
not working for software installed withPythonPackage
(see issue #2745)
- to fix
- tweak version regex in OpenSSL easyblock for compatiblity with Arch Linux (PR #2829)
- create
- enhancements
- refusing to build binutils when the system version is newer (issue #2817)
-
updates
- update version of
config.guess
used byConfigureMake
(issue #2826) - update LLVM easyblock to put '
cmake
' symlink in place so separate CMake modules requires for LLVM 15+ can be found (PR #2832)
- update version of
- new software
- add generic
JuliaBundle
easyblock (PR #2830)
- add generic
-
changes
- ...
- bug reports/fixes
-
easyconfigs
- still over 700 open easyconfig PRs...
- bug fixes/reports
- fix source_urls for colossalai (PR #16693)
- new software
- noteworthy software updates
- changes
-
framework
- See https://github.com/easybuilders/easybuild-docs (preview @ https://easybuilders.github.io/easybuild-docs)
- status
- pages that should be porting are mostly done
- almost boils down to auto-generated pages + API part
- WIP framework PR #4117 to add support for
--output-format=md
(used for auto-generated documentation) - still need to find a good way to handle the API documentation
- proposal for
foss/2022b
- see
foss/2022.10
- GCC 12.2.0 + binutils 2.39 (current latest)
- UCX 1.13.1 + libfabric 1.16.1 + OpenMPI v4.1.4 (current latest) - same as in
foss/2022a
- OpenBLAS 0.3.21 + FlexiBLAS 3.2.1 (current latest)
- FFTW 3.3.10 (current latest) - same as in
foss/2022a
- ScaLAPACK 2.2.0 (current latest) - same as in
foss/2022a
- see
- proposal for
intel/2022b
:- see
intel/2022.11
- upstream docs: https://software.intel.com/content/www/us/en/develop/articles/oneapi-standalone-components.html
- base: GCC 12.2.0 + binutils 2.39 (current latest)
- Intel C/C++/Fortran compilers 2022.2.1 (classic + oneAPI) (current latest)
- Intel MPI 2021.7.1 (current latest)
- Intel MKL 2022.2.1 (current latest)
- we should enable the use of oneAPI C/C++ compilers by default for this Intel compilers versions
- this will require separate toolchain options to enable C/C++ oneAPI compilers and Fortran oneAPI compilers
- see
- key software
- Mikael: working on framework PR for NVHPC-based full toolchain (incl. FlexiBLAS + OpenMPI)