{2023.06}[foss/2022a] Pillow V9.1.1 #202

TopRichard · 2023-10-10T12:35:29Z

The actual build issue with Pillow is that it can't find zlib through the hardcoded paths, the problem is solved by using --disable-platform-guessing (which was introduced in easybuilders/easybuild-easyconfigs#18881), and adding the appropriate paths to $CPATH and $LIBRARY_PATH via a hook.
License: https://spdx.org/licenses/HPND.html
Will install the following package:

Pillow/9.1.1-GCCcore-11.3.0 (Pillow-9.1.1-GCCcore-11.3.0.eb)

nessi-bot · 2023-10-10T12:35:34Z

Instance eX3-NESSI is configured to build:

arch x86_64/amd/zen2 for repo nessi-2022.11-swl-deb10
arch x86_64/amd/zen2 for repo nessi-2023.06-cl
arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb10
arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb11
arch aarch64/generic for repo nessi-2022.11-swl-deb10
arch aarch64/generic for repo nessi-2023.06-cl
arch aarch64/generic for repo nessi-2023.06-swl-deb10
arch aarch64/generic for repo nessi-2023.06-swl-deb11

nessi-bot · 2023-10-10T12:35:34Z

Instance AWS-NESSI is configured to build:

arch x86_64/generic for repo nessi-2022.11-swl-deb10
arch x86_64/generic for repo nessi-2023.06-cl
arch x86_64/generic for repo nessi-2023.06-swl-deb10
arch x86_64/generic for repo nessi-2023.06-swl-deb11
arch x86_64/intel/skylake_avx512 for repo nessi-2022.11-swl-deb10
arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-cl
arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb10
arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb11
arch x86_64/intel/cascadelake for repo nessi-2022.11-swl-deb10
arch x86_64/intel/cascadelake for repo nessi-2023.06-cl
arch x86_64/intel/cascadelake for repo nessi-2023.06-swl-deb10
arch x86_64/intel/cascadelake for repo nessi-2023.06-swl-deb11
arch x86_64/amd/zen2 for repo nessi-2022.11-swl-deb10
arch x86_64/amd/zen2 for repo nessi-2023.06-cl
arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb10
arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb11
arch aarch64/generic for repo nessi-2022.11-swl-deb10
arch aarch64/generic for repo nessi-2023.06-cl
arch aarch64/generic for repo nessi-2023.06-swl-deb10
arch aarch64/generic for repo nessi-2023.06-swl-deb11

nessi-bot · 2023-10-10T12:35:34Z

Instance Fram-NESSI is configured to build:

arch x86_64/generic for repo nessi-2022.11-swl-deb10
arch x86_64/generic for repo nessi-2023.06-cl
arch x86_64/generic for repo nessi-2023.06-swl-deb10
arch x86_64/generic for repo nessi-2023.06-swl-deb11
arch x86_64/intel/broadwell for repo nessi-2022.11-swl-deb10
arch x86_64/intel/broadwell for repo nessi-2023.06-cl
arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb10
arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb11

nessi-bot · 2023-10-10T12:35:34Z

Instance Saga-NESSI is configured to build:

arch x86_64/intel/cascadelake for repo nessi-2022.11-swl-deb10
arch x86_64/intel/cascadelake for repo nessi-2023.06-cl
arch x86_64/intel/cascadelake for repo nessi-2023.06-swl-deb10
arch x86_64/intel/cascadelake for repo nessi-2023.06-swl-deb11
arch x86_64/intel/skylake_avx512 for repo nessi-2022.11-swl-deb10
arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-cl
arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb10
arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb11
arch x86_64/generic for repo nessi-2022.11-swl-deb10
arch x86_64/generic for repo nessi-2023.06-cl
arch x86_64/generic for repo nessi-2023.06-swl-deb10
arch x86_64/generic for repo nessi-2023.06-swl-deb11

TopRichard · 2023-10-10T12:36:28Z

bot: build inst:AWS repo:nessi-2023.06-swl-deb11 arch:x86_64/generic
bot: build inst:AWS repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/cascadelake
bot: build inst:AWS repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake
bot: build inst:AWS repo:nessi-2023.06-swl-deb10 arch:zen2
bot: build inst:Fram-NESSI repo:nessi-2023.06-swl-deb10 arch:x86_64/intel/broadwell
bot: build inst:eX3 repo:nessi-2023.06-swl-deb11 arch:aarch64/generic

nessi-bot · 2023-10-10T12:36:31Z

Updates by the bot instance eX3-NESSI (click for details)

received bot command build inst:AWS repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from TopRichard
- expanded format: build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
received bot command build inst:AWS repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/cascadelake from TopRichard
- expanded format: build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/cascadelake
received bot command build inst:AWS repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from TopRichard
- expanded format: build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
received bot command build inst:AWS repo:nessi-2023.06-swl-deb10 arch:zen2 from TopRichard
- expanded format: build instance:AWS repository:nessi-2023.06-swl-deb10 architecture:zen2
received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb10 arch:x86_64/intel/broadwell from TopRichard
- expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb10 architecture:x86_64/intel/broadwell
received bot command build inst:eX3 repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from TopRichard
- expanded format: build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
handling command build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:
- no jobs were submitted
handling command build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/cascadelake resulted in:
- no jobs were submitted
handling command build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:
- no jobs were submitted
handling command build instance:AWS repository:nessi-2023.06-swl-deb10 architecture:zen2 resulted in:
- no jobs were submitted
handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb10 architecture:x86_64/intel/broadwell resulted in:
- no jobs were submitted
handling command build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:
- submitted job 14588, for details & status see {2023.06}[foss/2022a] Pillow V9.1.1 #202 (comment)

nessi-bot · 2023-10-10T12:36:31Z

Updates by the bot instance Fram-NESSI (click for details)

received bot command build inst:AWS repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from TopRichard
- expanded format: build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
received bot command build inst:AWS repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/cascadelake from TopRichard
- expanded format: build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/cascadelake
received bot command build inst:AWS repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from TopRichard
- expanded format: build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
received bot command build inst:AWS repo:nessi-2023.06-swl-deb10 arch:zen2 from TopRichard
- expanded format: build instance:AWS repository:nessi-2023.06-swl-deb10 architecture:zen2
received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb10 arch:x86_64/intel/broadwell from TopRichard
- expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb10 architecture:x86_64/intel/broadwell
received bot command build inst:eX3 repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from TopRichard
- expanded format: build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
handling command build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:
- no jobs were submitted
handling command build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/cascadelake resulted in:
- no jobs were submitted
handling command build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:
- no jobs were submitted
handling command build instance:AWS repository:nessi-2023.06-swl-deb10 architecture:zen2 resulted in:
- no jobs were submitted
handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb10 architecture:x86_64/intel/broadwell resulted in:
- submitted job 5427023, for details & status see {2023.06}[foss/2022a] Pillow V9.1.1 #202 (comment)
handling command build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:
- no jobs were submitted

nessi-bot · 2023-10-10T12:36:31Z

Updates by the bot instance AWS-NESSI (click for details)

received bot command build inst:AWS repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from TopRichard
- expanded format: build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
received bot command build inst:AWS repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/cascadelake from TopRichard
- expanded format: build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/cascadelake
received bot command build inst:AWS repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from TopRichard
- expanded format: build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
received bot command build inst:AWS repo:nessi-2023.06-swl-deb10 arch:zen2 from TopRichard
- expanded format: build instance:AWS repository:nessi-2023.06-swl-deb10 architecture:zen2
received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb10 arch:x86_64/intel/broadwell from TopRichard
- expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb10 architecture:x86_64/intel/broadwell
received bot command build inst:eX3 repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from TopRichard
- expanded format: build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
handling command build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:
- submitted job 8040, for details & status see {2023.06}[foss/2022a] Pillow V9.1.1 #202 (comment)
handling command build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/cascadelake resulted in:
- submitted job 8041, for details & status see {2023.06}[foss/2022a] Pillow V9.1.1 #202 (comment)
handling command build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:
- submitted job 8042, for details & status see {2023.06}[foss/2022a] Pillow V9.1.1 #202 (comment)
handling command build instance:AWS repository:nessi-2023.06-swl-deb10 architecture:zen2 resulted in:
- submitted job 8043, for details & status see {2023.06}[foss/2022a] Pillow V9.1.1 #202 (comment)
handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb10 architecture:x86_64/intel/broadwell resulted in:
- no jobs were submitted
handling command build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:
- no jobs were submitted

nessi-bot · 2023-10-10T12:36:32Z

Updates by the bot instance Saga-NESSI (click for details)

received bot command build inst:AWS repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from TopRichard
- expanded format: build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
received bot command build inst:AWS repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/cascadelake from TopRichard
- expanded format: build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/cascadelake
received bot command build inst:AWS repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from TopRichard
- expanded format: build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
received bot command build inst:AWS repo:nessi-2023.06-swl-deb10 arch:zen2 from TopRichard
- expanded format: build instance:AWS repository:nessi-2023.06-swl-deb10 architecture:zen2
received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb10 arch:x86_64/intel/broadwell from TopRichard
- expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb10 architecture:x86_64/intel/broadwell
received bot command build inst:eX3 repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from TopRichard
- expanded format: build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
handling command build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:
- no jobs were submitted
handling command build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/cascadelake resulted in:
- no jobs were submitted
handling command build instance:AWS repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:
- no jobs were submitted
handling command build instance:AWS repository:nessi-2023.06-swl-deb10 architecture:zen2 resulted in:
- no jobs were submitted
handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb10 architecture:x86_64/intel/broadwell resulted in:
- no jobs were submitted
handling command build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:
- no jobs were submitted

nessi-bot · 2023-10-10T12:36:39Z

New job on instance AWS-NESSI for architecture x86_64-generic for repository nessi-2023.06-swl-deb11 in job dir /mnt/shared/home/nessibot/pilot.nessi.no/PR155/jobs/2023.10/pr_202/8040

date	job status	comment
Oct 10 12:36:38 PM UTC 2023	submitted	job id `8040` awaits release by job manager
Oct 10 12:38:45 PM UTC 2023	released	job awaits launch by Slurm scheduler
Oct 10 12:42:54 PM UTC 2023	running	job `8040` is running
Oct 10 12:57:26 PM UTC 2023	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-8040.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-generic-1696942560.tar.gz` size: 1 MiB (1653063 bytes) entries: 223 modules under 2023.06/software/linux/x86_64/generic/modules/all `Pillow/9.1.1-GCCcore-11.3.0.lua` software under 2023.06/software/linux/x86_64/generic/software `Pillow/9.1.1-GCCcore-11.3.0` other under 2023.06/software/linux/x86_64/generic `.lmod/cache/spiderT.lua` `.lmod/cache/spiderT.luac_5.1` `.lmod/cache/timestamp`
Oct 11 12:47:35 PM UTC 2023	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-generic-1696942560.tar.gz` to S3 bucket succeeded
Oct 11 12:58:52 PM UTC 2023	staged	tarball `eessi-2023.06-software-linux-x86_64-generic-1696942560.tar.gz` downloaded to Stratum-0
Oct 11 01:00:12 PM UTC 2023	pr_opened	merge PR https://github.com/NorESSI/staging/pull/657 to approve ingest
Oct 11 01:03:16 PM UTC 2023	approved	👍 tarball `eessi-2023.06-software-linux-x86_64-generic-1696942560.tar.gz` approved, see PR https://github.com/NorESSI/staging/pull/657
Oct 11 01:04:58 PM UTC 2023	ingested	🎉 tarball `eessi-2023.06-software-linux-x86_64-generic-1696942560.tar.gz` successfully ingested at `2023.06/software/linux/x86_64/generic/`

nessi-bot · 2023-10-10T12:36:40Z

New job on instance Fram-NESSI for architecture x86_64-intel-broadwell for repository nessi-2023.06-swl-deb10 in job dir /cluster/projects/nn9992k/pilot.nessi.no/PR155/jobs/2023.10/pr_202/5427023

date	job status	comment
Oct 10 12:36:39 UTC 2023	submitted	job id `5427023` awaits release by job manager
Oct 10 12:36:48 UTC 2023	released	job awaits launch by Slurm scheduler
Oct 10 12:41:49 UTC 2023	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-5427023.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-intel-broadwell-1696941652.tar.gz` size: 1 MiB (1694724 bytes) entries: 223 modules under 2023.06/software/linux/x86_64/intel/broadwell/modules/all `Pillow/9.1.1-GCCcore-11.3.0.lua` software under 2023.06/software/linux/x86_64/intel/broadwell/software `Pillow/9.1.1-GCCcore-11.3.0` other under 2023.06/software/linux/x86_64/intel/broadwell `.lmod/cache/spiderT.lua` `.lmod/cache/spiderT.luac_5.1` `.lmod/cache/timestamp`
Oct 11 12:47:47 UTC 2023	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-broadwell-1696941652.tar.gz` to S3 bucket succeeded
Oct 11 12:58:55 PM UTC 2023	staged	tarball `eessi-2023.06-software-linux-x86_64-intel-broadwell-1696941652.tar.gz` downloaded to Stratum-0
Oct 11 01:00:16 PM UTC 2023	pr_opened	merge PR https://github.com/NorESSI/staging/pull/658 to approve ingest
Oct 11 01:03:19 PM UTC 2023	approved	👍 tarball `eessi-2023.06-software-linux-x86_64-intel-broadwell-1696941652.tar.gz` approved, see PR https://github.com/NorESSI/staging/pull/658
Oct 11 01:05:17 PM UTC 2023	ingested	🎉 tarball `eessi-2023.06-software-linux-x86_64-intel-broadwell-1696941652.tar.gz` successfully ingested at `2023.06/software/linux/x86_64/intel/broadwell/`

nessi-bot · 2023-10-10T12:36:40Z

New job on instance eX3-NESSI for architecture aarch64-generic for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/pilot.nessi.no/PR155/jobs/2023.10/pr_202/14588

date	job status	comment
Oct 10 12:36:14 PM UTC 2023	submitted	job id `14588` awaits release by job manager
Oct 10 12:40:03 PM UTC 2023	released	job awaits launch by Slurm scheduler
Oct 10 12:45:06 PM UTC 2023	running	job `14588` is running
Oct 10 12:50:07 PM UTC 2023	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-14588.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-generic-1696941923.tar.gz` size: 1 MiB (1602768 bytes) entries: 223 modules under 2023.06/software/linux/aarch64/generic/modules/all `Pillow/9.1.1-GCCcore-11.3.0.lua` software under 2023.06/software/linux/aarch64/generic/software `Pillow/9.1.1-GCCcore-11.3.0` other under 2023.06/software/linux/aarch64/generic `.lmod/cache/spiderT.lua` `.lmod/cache/spiderT.luac_5.1` `.lmod/cache/timestamp`
Oct 11 12:49:43 PM UTC 2023	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-generic-1696941923.tar.gz` to S3 bucket succeeded
Oct 11 12:58:45 PM UTC 2023	staged	tarball `eessi-2023.06-software-linux-aarch64-generic-1696941923.tar.gz` downloaded to Stratum-0
Oct 11 01:00:02 PM UTC 2023	pr_opened	merge PR https://github.com/NorESSI/staging/pull/655 to approve ingest
Oct 11 01:03:08 PM UTC 2023	approved	👍 tarball `eessi-2023.06-software-linux-aarch64-generic-1696941923.tar.gz` approved, see PR https://github.com/NorESSI/staging/pull/655
Oct 11 01:04:19 PM UTC 2023	ingested	🎉 tarball `eessi-2023.06-software-linux-aarch64-generic-1696941923.tar.gz` successfully ingested at `2023.06/software/linux/aarch64/generic/`

nessi-bot · 2023-10-10T12:36:47Z

New job on instance AWS-NESSI for architecture x86_64-intel-cascadelake for repository nessi-2023.06-swl-deb11 in job dir /mnt/shared/home/nessibot/pilot.nessi.no/PR155/jobs/2023.10/pr_202/8041

date	job status	comment
Oct 10 12:36:45 PM UTC 2023	submitted	job id `8041` awaits release by job manager
Oct 10 12:38:42 PM UTC 2023	released	job awaits launch by Slurm scheduler
Oct 10 12:42:52 PM UTC 2023	running	job `8041` is running
Oct 10 12:57:24 PM UTC 2023	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-8041.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-intel-cascadelake-1696942537.tar.gz` size: 1 MiB (1676730 bytes) entries: 223 modules under 2023.06/software/linux/x86_64/intel/cascadelake/modules/all `Pillow/9.1.1-GCCcore-11.3.0.lua` software under 2023.06/software/linux/x86_64/intel/cascadelake/software `Pillow/9.1.1-GCCcore-11.3.0` other under 2023.06/software/linux/x86_64/intel/cascadelake `.lmod/cache/spiderT.lua` `.lmod/cache/spiderT.luac_5.1` `.lmod/cache/timestamp`
Oct 11 12:47:56 PM UTC 2023	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-cascadelake-1696942537.tar.gz` to S3 bucket succeeded
Oct 11 12:58:58 PM UTC 2023	staged	tarball `eessi-2023.06-software-linux-x86_64-intel-cascadelake-1696942537.tar.gz` downloaded to Stratum-0
Oct 11 01:00:21 PM UTC 2023	pr_opened	merge PR https://github.com/NorESSI/staging/pull/659 to approve ingest
Oct 11 01:03:23 PM UTC 2023	approved	👍 tarball `eessi-2023.06-software-linux-x86_64-intel-cascadelake-1696942537.tar.gz` approved, see PR https://github.com/NorESSI/staging/pull/659
Oct 11 01:05:35 PM UTC 2023	ingested	🎉 tarball `eessi-2023.06-software-linux-x86_64-intel-cascadelake-1696942537.tar.gz` successfully ingested at `2023.06/software/linux/x86_64/intel/cascadelake/`

nessi-bot · 2023-10-10T12:36:54Z

New job on instance AWS-NESSI for architecture x86_64-intel-skylake_avx512 for repository nessi-2023.06-swl-deb11 in job dir /mnt/shared/home/nessibot/pilot.nessi.no/PR155/jobs/2023.10/pr_202/8042

date	job status	comment
Oct 10 12:36:53 PM UTC 2023	submitted	job id `8042` awaits release by job manager
Oct 10 12:38:40 PM UTC 2023	released	job awaits launch by Slurm scheduler
Oct 10 12:42:50 PM UTC 2023	running	job `8042` is running
Oct 10 12:57:22 PM UTC 2023	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-8042.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1696942553.tar.gz` size: 1 MiB (1676435 bytes) entries: 223 modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all `Pillow/9.1.1-GCCcore-11.3.0.lua` software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software `Pillow/9.1.1-GCCcore-11.3.0` other under 2023.06/software/linux/x86_64/intel/skylake_avx512 `.lmod/cache/spiderT.lua` `.lmod/cache/spiderT.luac_5.1` `.lmod/cache/timestamp`
Oct 11 12:47:45 PM UTC 2023	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1696942553.tar.gz` to S3 bucket succeeded
Oct 11 12:59:01 PM UTC 2023	staged	tarball `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1696942553.tar.gz` downloaded to Stratum-0
Oct 11 01:00:25 PM UTC 2023	pr_opened	merge PR https://github.com/NorESSI/staging/pull/660 to approve ingest
Oct 11 01:03:27 PM UTC 2023	approved	👍 tarball `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1696942553.tar.gz` approved, see PR https://github.com/NorESSI/staging/pull/660
Oct 11 01:05:51 PM UTC 2023	ingested	🎉 tarball `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1696942553.tar.gz` successfully ingested at `2023.06/software/linux/x86_64/intel/skylake_avx512/`

nessi-bot · 2023-10-10T12:37:01Z

New job on instance AWS-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb10 in job dir /mnt/shared/home/nessibot/pilot.nessi.no/PR155/jobs/2023.10/pr_202/8043

date	job status	comment
Oct 10 12:37:00 PM UTC 2023	submitted	job id `8043` awaits release by job manager
Oct 10 12:38:37 PM UTC 2023	released	job awaits launch by Slurm scheduler
Oct 10 12:42:47 PM UTC 2023	running	job `8043` is running
Oct 10 12:49:09 PM UTC 2023	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-8043.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-1696942131.tar.gz` size: 1 MiB (1695077 bytes) entries: 223 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all `Pillow/9.1.1-GCCcore-11.3.0.lua` software under 2023.06/software/linux/x86_64/amd/zen2/software `Pillow/9.1.1-GCCcore-11.3.0` other under 2023.06/software/linux/x86_64/amd/zen2 `.lmod/cache/spiderT.lua` `.lmod/cache/spiderT.luac_5.1` `.lmod/cache/timestamp`
Oct 11 12:48:06 PM UTC 2023	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-amd-zen2-1696942131.tar.gz` to S3 bucket succeeded
Oct 11 12:58:48 PM UTC 2023	staged	tarball `eessi-2023.06-software-linux-x86_64-amd-zen2-1696942131.tar.gz` downloaded to Stratum-0
Oct 11 01:00:07 PM UTC 2023	pr_opened	merge PR https://github.com/NorESSI/staging/pull/656 to approve ingest
Oct 11 01:03:12 PM UTC 2023	approved	👍 tarball `eessi-2023.06-software-linux-x86_64-amd-zen2-1696942131.tar.gz` approved, see PR https://github.com/NorESSI/staging/pull/656
Oct 11 01:04:38 PM UTC 2023	ingested	🎉 tarball `eessi-2023.06-software-linux-x86_64-amd-zen2-1696942131.tar.gz` successfully ingested at `2023.06/software/linux/x86_64/amd/zen2/`

trz42

Looks good overall. Some suggestions to keep the overall design of the hooks file consistent.

Instead of setting the envvars, the EESSI_* paths should be added. Otherwise, existing values could be overwritten.

trz42 · 2023-10-11T07:23:02Z

eb_hooks.py

@@ -33,6 +33,18 @@ def get_eessi_envvar(eessi_envvar):

    return eessi_envvar_value

+def set_Pillow_envvars(ec):


Should be named similarly to the other parse_hooks and the arguments should have eprefix too, for example,

def parse_hook_pillow_set_cpath_library_path(ec, eprefix):

The whole function should be moved to where it fits alphabetically (alphabetically ordered functions help in finding a function).

trz42 · 2023-10-11T07:26:02Z

eb_hooks.py

+    EESSI_CPATH = os.getenv('EESSI_EPREFIX') + '/usr/include'
+    EESSI_LIB_PATH = os.getenv('EESSI_EPREFIX') + '/usr/lib64'


These two lines should probably be moved inside the if block?

trz42 · 2023-10-11T07:30:57Z

eb_hooks.py

+        os.environ['CPATH'] = os.pathsep + EESSI_CPATH
+        os.environ['LIBRARY_PATH'] = os.pathsep + EESSI_LIB_PATH


These lines set the environment variables. The description of the PR says adding. I think it would be better to keep existing values, maybe something like the following could work

os.environ['CPATH'] = os.pathsep.join(os.environ.get('CPATH', ''), EESSI_CPATH)

If this works, could be checked in an interactive Python session.

I am setting the CPATH, but adding to the existing CPATH value, yet we can set whichever suits best.

The following could work

os.environ['CPATH'] = os.pathsep.join(filter(None,[os.environ.get('CPATH',''), EESSI_CPATH]))

I am setting the CPATH, but adding to the existing CPATH value, yet we can set whichever suits best.

CPATH may already be set to some value. If so it would be overwritten. That could lead then to other issues difficult to debug.

trz42 · 2023-10-11T07:38:17Z

eb_hooks.py

+        print_msg("NOTE: For Pillow which has Szip as a dependancy, CPATH has been set to %s", os.getenv('CPATH'))
+        print_msg("NOTE: For Pillow which has Szip as a dependancy, LIBRARY_PATH has been set to %s", os.getenv('LIBRARY_PATH'))
+        ec.log.info("NOTE: For Pillow which has Szip as a dependancy, CPATH has been set to %s", os.getenv('CPATH'))
+        ec.log.info("NOTE: For Pillow which has Szip as a dependancy, LIBRARY_PATH has been set to %s", os.getenv('LIBRARY_PATH'))


Here Szip is mentioned while earlier not finding zlib was the problem.

The messages could be a bit improved (particularly when adding directories), by stating something like

original CPATH (OLD_VALUE) has been extended with EESSI_CPATH, new CPATH is NEW_VALUE

or just

CPATH (original value OLD_VALUE) has been extended with EESSI_CPATH

trz42 · 2023-10-11T07:44:02Z

eb_hooks.py

@@ -62,6 +74,7 @@ def parse_hook(ec, *args, **kwargs):
    # determine path to Prefix installation in compat layer via $EPREFIX
    eprefix = get_eessi_envvar('EPREFIX')

+    set_Pillow_envvars(ec)


The new hook should be called via line (just 2 lines below where it is called now)

PARSE_HOOKS[ec.name](ec, eprefix)

This requires that a line

'Pillow': parse_hook_pillow_set_cpath_library_path,

is added to the PARSE_HOOKS dictionary (near the end of the file).

trz42 · 2023-10-11T07:44:54Z

eessi-2023.06-eb-4.8.1-2022a.yml

@@ -51,3 +51,7 @@ easyconfigs:
  - Tk-8.6.12-GCCcore-11.3.0.eb
  - GROMACS-2023.1-foss-2022a.eb
  - MUMPS-5.5.1-foss-2022a-metis.eb
+  - Pillow-9.1.1-GCCcore-11.3.0.eb:
+      # Uses a custom hook since has Szip as dependency which has hard coded header and library path within Pillow code.


Is it Szip or zlib?

100%, will fix

trz42

Few additional suggestions.

trz42 · 2023-10-11T10:03:55Z

eb_hooks.py

@@ -66,6 +66,23 @@ def parse_hook(ec, *args, **kwargs):
        PARSE_HOOKS[ec.name](ec, eprefix)


+def parse_hook_pillow_set_cpath_library_path(ec, eprefix):
+    """Get EESSI_CPATH environment variable from the environment"""


Actually, the hook augments env vars CPATH and LIBRARY_PATH with paths including the EESSI_PREFIX.

Mention LIBRARY_PATH too?

Does this look good : Extend CPATH and LIBRARY_PATH environment variables using EESSI_EPREFIX.

trz42 · 2023-10-11T10:07:18Z

eb_hooks.py

+        print_msg("NOTE:Pillow has zlib as a dependancy,the original CPATH value: (%s) has been extended with (%s)",
+                  os.getenv('CPATH'),  EESSI_CPATH)
+        print_msg("NOTE:Pillow has zlib as a dependancy,the original LIBRARY_PATH value: (%s) has been extended with (%s)",
+                  os.getenv('LIBRARY_PATH'),  EESSI_LIB_PATH)
+        ec.log.info("NOTE:Pillow has zlib as a dependancy,the original CPATH value: (%s)  has been extended with (%s)",
+                    os.getenv('CPATH'), EESSI_CPATH)
+        ec.log.info("NOTE:Pillow has zlib as a dependancy,the original LIBRARY_VALUE value: (%s) has been extended with (%s)",
+                    os.getenv('LIBRARY_PATH'), EESSI_LIB_PATH)


Minor suggestion on formatting. Added spaces.

"NOTE: Pillow has zlib as a dependency. The original CPATH ..."

trz42 · 2023-10-11T10:09:57Z

eb_hooks.py

@@ -273,6 +290,7 @@ def pre_test_hook_ignore_failing_tests_SciPybundle(self, *args, **kwargs):
    'fontconfig': parse_hook_fontconfig_add_fonts,
    'OpenBLAS': parse_hook_openblas_relax_lapack_tests_num_errors,
    'UCX': parse_hook_ucx_eprefix,
+    'Pillow': parse_hook_pillow_set_cpath_library_path,


Could you order the entries alphabetically ... one line upwards.

trz42 · 2023-10-11T10:12:20Z

eb_hooks.py

@@ -66,6 +66,23 @@ def parse_hook(ec, *args, **kwargs):
        PARSE_HOOKS[ec.name](ec, eprefix)


+def parse_hook_pillow_set_cpath_library_path(ec, eprefix):


Could you move the whole function to where the other parse hooks are defined?

TopRichard · 2023-10-11T12:46:45Z

Checklist for building Pillow V9.1.1:

Check whether builds for all required architectures succeed (SUCCESS message + reasonably sized tarball)
Check if the PR is up-to-date with the target branch nessi.no-2023.06 in the repository (if not what are the differences)
Assess if all requested changes are sound (checking files changed on GitHub.com)
Verify that all easyconfig/s being built are included with the EB version used (if not why not)
[] Review changes (if any) needed to get the build(s) succeed (common changes for all architectures, changes for a single architecture, changes because of build environment specifics, etc.)
Pillow can't find zlib through the hardcoded paths, the problem is solved using --disable-platform-guessing and adding the appropriate paths to $CPATH and $LIBRARY_PATH via a hook.

TopRichard · 2023-10-11T13:17:19Z

Target architectures

x86_64-intel-broadwell
x86_64-intel-skylake_avx512
x86_64-intel-cascadelake
x86_64-amd-zen2
x86_64-generic
aarch64-generic

Checklist for deployment/ingestion

at least one tarball for each architecture has been uploaded
at least one tarball for each architecture has been staged
for each architecture one and only one tarball has been approved
for each architecture one and only one tarball was ingested
[] encountered issues in the ingestion, likely related to troubles interacting with GitHub via PyGithub …
all tests in the CI have succeeded (rerun failed tests ~ 10 mins after last ingest)
has the package become available via CernVM-FS for all architectures ingested (for lmod cache updates pay attention to timestamp of files)

command & log

command

cd /cvmfs/pilot.nessi.no/versions/2023.06/software/linux ; 
ls -l \
      x86_64/{generic,amd/zen2,intel/[bsc]*}/{software,modules/all}/Pillow/9.1.1-GCCcore-11.3.0* \
      aarch64/generic/{software,modules/all}/Pillow/9.1.1-GCCcore-11.3.0*

-rw-r--r--. 1 cvmfs cvmfs 1600 Oct 10 12:43 aarch64/generic/modules/all/Pillow/9.1.1-GCCcore-11.3.0.lua
-rw-r--r--. 1 cvmfs cvmfs 1600 Oct 10 12:47 x86_64/amd/zen2/modules/all/Pillow/9.1.1-GCCcore-11.3.0.lua
-rw-r--r--. 1 cvmfs cvmfs 1599 Oct 10 12:54 x86_64/generic/modules/all/Pillow/9.1.1-GCCcore-11.3.0.lua
-rw-rw-r--. 1 cvmfs cvmfs 1607 Oct 10 12:39 x86_64/intel/broadwell/modules/all/Pillow/9.1.1-GCCcore-11.3.0.lua
-rw-r--r--. 1 cvmfs cvmfs 1609 Oct 10 12:54 x86_64/intel/cascadelake/modules/all/Pillow/9.1.1-GCCcore-11.3.0.lua
-rw-r--r--. 1 cvmfs cvmfs 1612 Oct 10 12:54 x86_64/intel/skylake_avx512/modules/all/Pillow/9.1.1-GCCcore-11.3.0.lua

aarch64/generic/software/Pillow/9.1.1-GCCcore-11.3.0:
total 10
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Oct 10 12:43 easybuild
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Oct 10 12:41 lib
lrwxrwxrwx. 1 cvmfs cvmfs 3 Oct 10 12:42 lib64 -> lib

x86_64/amd/zen2/software/Pillow/9.1.1-GCCcore-11.3.0:
total 10
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Oct 10 12:47 easybuild
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Oct 10 12:45 lib
lrwxrwxrwx. 1 cvmfs cvmfs 3 Oct 10 12:47 lib64 -> lib

x86_64/generic/software/Pillow/9.1.1-GCCcore-11.3.0:
total 10
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Oct 10 12:54 easybuild
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Oct 10 12:50 lib
lrwxrwxrwx. 1 cvmfs cvmfs 3 Oct 10 12:54 lib64 -> lib

x86_64/intel/broadwell/software/Pillow/9.1.1-GCCcore-11.3.0:
total 10
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Oct 10 12:39 easybuild
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Oct 10 12:38 lib
lrwxrwxrwx. 1 cvmfs cvmfs 3 Oct 10 12:39 lib64 -> lib

x86_64/intel/cascadelake/software/Pillow/9.1.1-GCCcore-11.3.0:
total 10
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Oct 10 12:54 easybuild
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Oct 10 12:50 lib
lrwxrwxrwx. 1 cvmfs cvmfs 3 Oct 10 12:54 lib64 -> lib

x86_64/intel/skylake_avx512/software/Pillow/9.1.1-GCCcore-11.3.0:
total 10
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Oct 10 12:54 easybuild
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Oct 10 12:50 lib
lrwxrwxrwx. 1 cvmfs cvmfs 3 Oct 10 12:54 lib64 -> lib

</details>

TopRichard added the NESSI/2023.06 label Oct 10, 2023

TopRichard mentioned this pull request Oct 10, 2023

{2023.06}[foss/2022a] ASE V3.22.1 #180

Merged

TopRichard requested a review from trz42 October 10, 2023 14:23

trz42 requested changes Oct 11, 2023

View reviewed changes

Added requested changes

9c5daa9

TopRichard force-pushed the nessi.no-2023.06-Pillow/9.1.1-foss/2022a branch from 2d45617 to 9c5daa9 Compare October 11, 2023 09:51

trz42 requested changes Oct 11, 2023

View reviewed changes

Richard Top added 2 commits October 11, 2023 10:34

Added additional requested changes

6ff2f28

Added latest modifications

6b80c9f

trz42 approved these changes Oct 11, 2023

View reviewed changes

TopRichard added bot:deploy ingested labels Oct 11, 2023

TopRichard merged commit 58fc0e6 into NorESSI:nessi.no-2023.06 Oct 11, 2023
72 of 73 checks passed

		@@ -33,6 +33,18 @@ def get_eessi_envvar(eessi_envvar):

		return eessi_envvar_value

		def set_Pillow_envvars(ec):

		EESSI_CPATH = os.getenv('EESSI_EPREFIX') + '/usr/include'
		EESSI_LIB_PATH = os.getenv('EESSI_EPREFIX') + '/usr/lib64'

		os.environ['CPATH'] = os.pathsep + EESSI_CPATH
		os.environ['LIBRARY_PATH'] = os.pathsep + EESSI_LIB_PATH

		@@ -66,6 +66,23 @@ def parse_hook(ec, args, *kwargs):
		PARSE_HOOKS[ec.name](ec, eprefix)


		def parse_hook_pillow_set_cpath_library_path(ec, eprefix):

{2023.06}[foss/2022a] Pillow V9.1.1 #202

{2023.06}[foss/2022a] Pillow V9.1.1 #202

Conversation

TopRichard commented Oct 10, 2023 • edited Loading

nessi-bot bot commented Oct 10, 2023

nessi-bot bot commented Oct 10, 2023

nessi-bot bot commented Oct 10, 2023

nessi-bot bot commented Oct 10, 2023

TopRichard commented Oct 10, 2023

nessi-bot bot commented Oct 10, 2023 • edited Loading

nessi-bot bot commented Oct 10, 2023 • edited Loading

nessi-bot bot commented Oct 10, 2023 • edited Loading

nessi-bot bot commented Oct 10, 2023 • edited Loading

nessi-bot bot commented Oct 10, 2023 • edited by trz42 Loading

nessi-bot bot commented Oct 10, 2023 • edited by trz42 Loading

nessi-bot bot commented Oct 10, 2023 • edited by trz42 Loading

nessi-bot bot commented Oct 10, 2023 • edited by trz42 Loading

nessi-bot bot commented Oct 10, 2023 • edited by trz42 Loading

nessi-bot bot commented Oct 10, 2023 • edited by trz42 Loading

trz42 left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

TopRichard Oct 11, 2023 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

trz42 left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

TopRichard commented Oct 11, 2023

TopRichard commented Oct 11, 2023

TopRichard commented Oct 10, 2023 •

edited

Loading

nessi-bot bot commented Oct 10, 2023 •

edited

Loading

nessi-bot bot commented Oct 10, 2023 •

edited

Loading

nessi-bot bot commented Oct 10, 2023 •

edited

Loading

nessi-bot bot commented Oct 10, 2023 •

edited

Loading

nessi-bot bot commented Oct 10, 2023 •

edited by trz42

Loading

nessi-bot bot commented Oct 10, 2023 •

edited by trz42

Loading

nessi-bot bot commented Oct 10, 2023 •

edited by trz42

Loading

nessi-bot bot commented Oct 10, 2023 •

edited by trz42

Loading

nessi-bot bot commented Oct 10, 2023 •

edited by trz42

Loading

nessi-bot bot commented Oct 10, 2023 •

edited by trz42

Loading

TopRichard Oct 11, 2023 •

edited

Loading