{2023.06}[system] EasyBuild v4.9.1 #314

trz42 · 2024-04-10T19:35:42Z

PR to add EasyBuild 4.9.1

SPDX license identifier: GPL-2.0-only

Also used to verify if building still works after #312 has been merged.

Plus used as a trial for building some (or all) aarch64/generic software on AWS.

That didn't work. See {2023.06}[system] EasyBuild v4.9.1 #314 (comment)

trz42 · 2024-04-10T19:36:47Z

bot: build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell
bot: build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic

nessi-bot · 2024-04-10T19:36:51Z

Updates by the bot instance AWS-MC-NESSI (click for details)

received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42
- expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42
- expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:
- no jobs were submitted
handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:
- no jobs were submitted
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:
- submitted job 9280, for details & status see {2023.06}[system] EasyBuild v4.9.1 #314 (comment)
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- submitted job 9281, for details & status see {2023.06}[system] EasyBuild v4.9.1 #314 (comment)
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:
- submitted job 9282, for details & status see {2023.06}[system] EasyBuild v4.9.1 #314 (comment)

nessi-bot · 2024-04-10T19:36:51Z

Updates by the bot instance eX3-NESSI (click for details)

received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42
- expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42
- expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:
- no jobs were submitted
handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:
- no jobs were submitted
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:
- no jobs were submitted
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:
- no jobs were submitted

nessi-bot · 2024-04-10T19:36:51Z

Updates by the bot instance Fram-NESSI (click for details)

received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42
- expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42
- expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:
- submitted job 5764528, for details & status see {2023.06}[system] EasyBuild v4.9.1 #314 (comment)
handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:
- no jobs were submitted
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:
- no jobs were submitted
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:
- no jobs were submitted

nessi-bot · 2024-04-10T19:36:51Z

Updates by the bot instance Saga-NESSI (click for details)

received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42
- expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42
- expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:
- no jobs were submitted
handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:
- submitted job 11139889, for details & status see {2023.06}[system] EasyBuild v4.9.1 #314 (comment)
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:
- no jobs were submitted
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:
- no jobs were submitted

nessi-bot · 2024-04-10T19:36:55Z

New job on instance Fram-NESSI for architecture x86_64-intel-broadwell for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_314/5764528

date	job status	comment
Apr 10 19:36:54 UTC 2024	submitted	job id `5764528` awaits release by job manager
Apr 10 19:37:47 UTC 2024	released	job awaits launch by Slurm scheduler
Apr 10 19:38:49 UTC 2024	running	job `5764528` is running
Apr 10 19:42:54 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-5764528.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-intel-broadwell-1712778139.tar.gz` size: 20 MiB (20982472 bytes) entries: 32611 modules under 2023.06/software/linux/x86_64/intel/broadwell/modules/all `EasyBuild/4.9.1.lua` software under 2023.06/software/linux/x86_64/intel/broadwell/software `EasyBuild/4.9.1` other under 2023.06/software/linux/x86_64/intel/broadwell no other files in tarball
Apr 10 19:42:54 UTC 2024	test result	(no tests yet)
Apr 10 20:43:46 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-broadwell-1712778139.tar.gz` to S3 bucket succeeded
Apr 10 20:52:30 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-broadwell-1712778139.tar.gz` to S3 bucket succeeded
Apr 10 20:58:17 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-broadwell-1712778139.tar.gz` to S3 bucket succeeded
Apr 10 21:28:12 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-broadwell-1712778139.tar.gz` to S3 bucket succeeded
Apr 10 10:20:09 PM UTC 2024	staged	tarball `eessi-2023.06-software-linux-x86_64-intel-broadwell-1712778139.tar.gz` downloaded to Stratum-0
Apr 10 10:20:53 PM UTC 2024	pr_opened	merge PR https://github.com/NorESSI/2024-staging/pull/119 to approve ingest
Apr 10 10:26:43 PM UTC 2024	approved	👍 tarball `eessi-2023.06-software-linux-x86_64-intel-broadwell-1712778139.tar.gz` approved, see PR https://github.com/NorESSI/2024-staging/pull/119
Apr 10 10:32:21 PM UTC 2024	ingested	🎉 tarball `eessi-2023.06-software-linux-x86_64-intel-broadwell-1712778139.tar.gz` successfully ingested at `2023.06/software/linux/x86_64/intel/broadwell/`

nessi-bot · 2024-04-10T19:36:55Z

New job on instance AWS-MC-NESSI for architecture aarch64-generic for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_314/9280

failed with

== FAILED: Installation ended unsuccessfully (build directory: /tmp/tmp.GhoI8Ls8fG/build/CUDA/12.1.1/system-system): build failed (first 300 chars):
Sanity check failed: loading fake module failed: "Module command '/cvmfs/pilot.nessi.no/versions/2023.06/compat/linux/aarch64/usr/share/Lmod/libexec/lmod python load CUDA/12.1.1' failed with exit code 1; stderr: Lmod has detected the following error:\nYou requested to load CUDA  but while the module (took 5 mins 19 secs)
== Results of the build can be found in the log file(s) /tmp/eb-f9almw2x/easybuild-CUDA-12.1.1-20240410.194554.HSAEy.log
ERROR: Build of /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/software/EasyBuild/4.9.0/easybuild/easyconfigs/c/CUDA/CUDA-12.1.1.eb failed (err: 'build failed (first 300 chars): Sanity check failed: loading fake module failed: "Module command \'/cvmfs/pilot.nessi.no/versions/2023.06/compat/linux/aarch64/usr/share/Lmod/libexec/lmod python load CUDA/12.1.1\' failed with exit code 1; stderr: Lmod has detected the following error:\\nYou requested to load CUDA  but while the module')
ESC[31mERROR: CUDA installation failed, please check EasyBuild logs easybuild-ck0u4k0s.log...ESC[0m

date	job status	comment
Apr 10 19:36:54 UTC 2024	submitted	job id `9280` awaits release by job manager
Apr 10 19:37:10 UTC 2024	released	job awaits launch by Slurm scheduler
Apr 10 19:42:24 UTC 2024	running	job `9280` is running
Apr 10 19:56:44 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-9280.out` ❌ found message matching `ERROR:` ❌ found message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-generic-1712778944.tar.gz` size: 19 MiB (20879875 bytes) entries: 32611 modules under 2023.06/software/linux/aarch64/generic/modules/all `EasyBuild/4.9.1.lua` software under 2023.06/software/linux/aarch64/generic/software `EasyBuild/4.9.1` other under 2023.06/software/linux/aarch64/generic no other files in tarball
Apr 10 19:56:44 UTC 2024	test result	(no tests yet)
Apr 10 20:43:40 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-generic-1712778944.tar.gz` to S3 bucket succeeded
Apr 10 20:52:31 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-generic-1712778944.tar.gz` to S3 bucket succeeded
Apr 10 20:58:19 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-generic-1712778944.tar.gz` to S3 bucket succeeded
Apr 10 21:28:13 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-generic-1712778944.tar.gz` to S3 bucket succeeded
Apr 10 10:19:59 PM UTC 2024	staged	tarball `eessi-2023.06-software-linux-aarch64-generic-1712778944.tar.gz` downloaded to Stratum-0
Apr 10 10:20:22 PM UTC 2024	pr_opened	merge PR https://github.com/NorESSI/2024-staging/pull/115 to approve ingest
Apr 10 10:26:35 PM UTC 2024	rejected	👎 tarball `eessi-2023.06-software-linux-aarch64-generic-1712778944.tar.gz` rejected, see PR https://github.com/NorESSI/2024-staging/pull/115

nessi-bot · 2024-04-10T19:36:58Z

New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_314/9281

date	job status	comment
Apr 10 19:36:58 UTC 2024	submitted	job id `9281` awaits release by job manager
Apr 10 19:37:12 UTC 2024	released	job awaits launch by Slurm scheduler
Apr 10 19:38:16 UTC 2024	running	job `9281` is running
Apr 10 19:44:31 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-9281.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-1712778206.tar.gz` size: 19 MiB (20922641 bytes) entries: 32611 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all `EasyBuild/4.9.1.lua` software under 2023.06/software/linux/x86_64/amd/zen2/software `EasyBuild/4.9.1` other under 2023.06/software/linux/x86_64/amd/zen2 no other files in tarball
Apr 10 19:44:31 UTC 2024	test result	(no tests yet)
Apr 10 20:44:00 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-amd-zen2-1712778206.tar.gz` to S3 bucket succeeded
Apr 10 20:52:52 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-amd-zen2-1712778206.tar.gz` to S3 bucket succeeded
Apr 10 20:58:39 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-amd-zen2-1712778206.tar.gz` to S3 bucket succeeded
Apr 10 21:28:33 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-amd-zen2-1712778206.tar.gz` to S3 bucket succeeded
Apr 10 10:20:04 PM UTC 2024	staged	tarball `eessi-2023.06-software-linux-x86_64-amd-zen2-1712778206.tar.gz` downloaded to Stratum-0
Apr 10 10:20:38 PM UTC 2024	pr_opened	merge PR https://github.com/NorESSI/2024-staging/pull/117 to approve ingest
Apr 10 10:26:39 PM UTC 2024	approved	👍 tarball `eessi-2023.06-software-linux-x86_64-amd-zen2-1712778206.tar.gz` approved, see PR https://github.com/NorESSI/2024-staging/pull/117
Apr 10 10:29:45 PM UTC 2024	ingested	🎉 tarball `eessi-2023.06-software-linux-x86_64-amd-zen2-1712778206.tar.gz` successfully ingested at `2023.06/software/linux/x86_64/amd/zen2/`

nessi-bot · 2024-04-10T19:37:02Z

New job on instance AWS-MC-NESSI for architecture x86_64-generic for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_314/9282

date	job status	comment
Apr 10 19:37:01 UTC 2024	submitted	job id `9282` awaits release by job manager
Apr 10 19:37:14 UTC 2024	released	job awaits launch by Slurm scheduler
Apr 10 19:38:17 UTC 2024	running	job `9282` is running
Apr 10 19:44:32 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-9282.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-generic-1712778206.tar.gz` size: 19 MiB (20911671 bytes) entries: 32611 modules under 2023.06/software/linux/x86_64/generic/modules/all `EasyBuild/4.9.1.lua` software under 2023.06/software/linux/x86_64/generic/software `EasyBuild/4.9.1` other under 2023.06/software/linux/x86_64/generic no other files in tarball
Apr 10 19:44:32 UTC 2024	test result	(no tests yet)
Apr 10 20:44:21 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-generic-1712778206.tar.gz` to S3 bucket succeeded
Apr 10 20:53:13 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-generic-1712778206.tar.gz` to S3 bucket succeeded
Apr 10 20:58:59 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-generic-1712778206.tar.gz` to S3 bucket succeeded
Apr 10 21:28:54 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-generic-1712778206.tar.gz` to S3 bucket succeeded
Apr 10 10:20:07 PM UTC 2024	staged	tarball `eessi-2023.06-software-linux-x86_64-generic-1712778206.tar.gz` downloaded to Stratum-0
Apr 10 10:20:46 PM UTC 2024	pr_opened	merge PR https://github.com/NorESSI/2024-staging/pull/118 to approve ingest
Apr 10 10:26:41 PM UTC 2024	approved	👍 tarball `eessi-2023.06-software-linux-x86_64-generic-1712778206.tar.gz` approved, see PR https://github.com/NorESSI/2024-staging/pull/118
Apr 10 10:31:12 PM UTC 2024	ingested	🎉 tarball `eessi-2023.06-software-linux-x86_64-generic-1712778206.tar.gz` successfully ingested at `2023.06/software/linux/x86_64/generic/`

nessi-bot · 2024-04-10T19:37:13Z

Instance eX3-NESSI is configured to build:

arch x86_64/amd/zen2 for repo nessi-2023.06-cl
arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb10
arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb11
arch aarch64/generic for repo nessi-2023.06-cl
arch aarch64/generic for repo nessi-2023.06-swl-deb10
arch aarch64/generic for repo nessi-2023.06-swl-deb11

nessi-bot · 2024-04-10T19:37:13Z

Instance AWS-MC-NESSI is configured to build:

arch x86_64/generic for repo nessi-2022.11-swl-deb10
arch x86_64/generic for repo nessi-2023.06-cl
arch x86_64/generic for repo nessi-2023.06-swl-deb10
arch x86_64/generic for repo nessi-2023.06-swl-deb11
arch x86_64/intel/skylake_avx512 for repo nessi-2022.11-swl-deb10
arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-cl
arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb10
arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb11
arch x86_64/amd/zen2 for repo nessi-2022.11-swl-deb10
arch x86_64/amd/zen2 for repo nessi-2023.06-cl
arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb10
arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb11
arch aarch64/generic for repo nessi-2022.11-swl-deb10
arch aarch64/generic for repo nessi-2023.06-cl
arch aarch64/generic for repo nessi-2023.06-swl-deb10
arch aarch64/generic for repo nessi-2023.06-swl-deb11

nessi-bot · 2024-04-10T19:37:13Z

Instance Fram-NESSI is configured to build:

arch x86_64/generic for repo nessi-2023.06-cl
arch x86_64/generic for repo nessi-2023.06-swl-deb10
arch x86_64/generic for repo nessi-2023.06-swl-deb11
arch x86_64/intel/broadwell for repo nessi-2023.06-cl
arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb10
arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb11

nessi-bot · 2024-04-10T19:37:13Z

Instance Saga-NESSI is configured to build:

arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-cl
arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb10
arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb11
arch x86_64/intel/broadwell for repo nessi-2023.06-cl
arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb10
arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb11
arch x86_64/generic for repo nessi-2023.06-cl
arch x86_64/generic for repo nessi-2023.06-swl-deb10
arch x86_64/generic for repo nessi-2023.06-swl-deb11

nessi-bot · 2024-04-10T19:37:14Z

New job on instance Saga-NESSI for architecture x86_64-intel-skylake_avx512 for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_314/11139889

date	job status	comment
Apr 10 07:37:13 PM UTC 2024	submitted	job id `11139889` awaits release by job manager
Apr 10 07:37:21 PM UTC 2024	released	job awaits launch by Slurm scheduler
Apr 10 07:38:23 PM UTC 2024	running	job `11139889` is running
Apr 10 07:44:30 PM UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-11139889.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712778218.tar.gz` size: 20 MiB (21029172 bytes) entries: 32611 modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all `EasyBuild/4.9.1.lua` software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software `EasyBuild/4.9.1` other under 2023.06/software/linux/x86_64/intel/skylake_avx512 no other files in tarball
Apr 10 07:44:30 PM UTC 2024	test result	(no tests yet)
Apr 10 08:43:49 PM UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712778218.tar.gz` to S3 bucket succeeded
Apr 10 08:52:33 PM UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712778218.tar.gz` to S3 bucket succeeded
Apr 10 08:58:22 PM UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712778218.tar.gz` to S3 bucket succeeded
Apr 10 09:28:19 PM UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712778218.tar.gz` to S3 bucket succeeded
Apr 10 10:20:12 PM UTC 2024	staged	tarball `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712778218.tar.gz` downloaded to Stratum-0
Apr 10 10:21:02 PM UTC 2024	pr_opened	merge PR https://github.com/NorESSI/2024-staging/pull/120 to approve ingest
Apr 10 10:26:46 PM UTC 2024	approved	👍 tarball `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712778218.tar.gz` approved, see PR https://github.com/NorESSI/2024-staging/pull/120
Apr 10 10:33:21 PM UTC 2024	ingested	🎉 tarball `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712778218.tar.gz` successfully ingested at `2023.06/software/linux/x86_64/intel/skylake_avx512/`

trz42 · 2024-04-10T20:12:00Z

bot: build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic

nessi-bot · 2024-04-10T20:12:04Z

Updates by the bot instance AWS-MC-NESSI (click for details)

received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42
- expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:
- no jobs were submitted

nessi-bot · 2024-04-10T20:12:04Z

Updates by the bot instance eX3-NESSI (click for details)

received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42
- expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:
- submitted job 166838, for details & status see {2023.06}[system] EasyBuild v4.9.1 #314 (comment)

nessi-bot · 2024-04-10T20:12:04Z

Updates by the bot instance Fram-NESSI (click for details)

received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42
- expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:
- no jobs were submitted

nessi-bot · 2024-04-10T20:12:04Z

Updates by the bot instance Saga-NESSI (click for details)

received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42
- expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:
- no jobs were submitted

nessi-bot · 2024-04-10T20:12:08Z

New job on instance eX3-NESSI for architecture aarch64-generic for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/pilot.nessi.no/jobs/2024.04/pr_314/166838

date	job status	comment
Apr 10 08:12:07 PM UTC 2024	submitted	job id `166838` awaits release by job manager
Apr 10 08:12:54 PM UTC 2024	released	job awaits launch by Slurm scheduler
Apr 10 08:13:56 PM UTC 2024	running	job `166838` is running
Apr 10 08:20:09 PM UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-166838.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-generic-1712780360.tar.gz` size: 20 MiB (21015508 bytes) entries: 32611 modules under 2023.06/software/linux/aarch64/generic/modules/all `EasyBuild/4.9.1.lua` software under 2023.06/software/linux/aarch64/generic/software `EasyBuild/4.9.1` other under 2023.06/software/linux/aarch64/generic no other files in tarball
Apr 10 08:20:09 PM UTC 2024	test result	(no tests yet)
Apr 10 08:49:16 PM UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-generic-1712780360.tar.gz` to S3 bucket succeeded
Apr 10 08:56:59 PM UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-generic-1712780360.tar.gz` to S3 bucket succeeded
Apr 10 09:04:16 PM UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-generic-1712780360.tar.gz` to S3 bucket succeeded
Apr 10 09:37:14 PM UTC 2024	not uploaded	transfer of `eessi-2023.06-software-linux-aarch64-generic-1712780360.tar.gz` to S3 bucket failed
Apr 10 10:20:01 PM UTC 2024	staged	tarball `eessi-2023.06-software-linux-aarch64-generic-1712780360.tar.gz` downloaded to Stratum-0
Apr 10 10:20:30 PM UTC 2024	pr_opened	merge PR https://github.com/NorESSI/2024-staging/pull/116 to approve ingest
Apr 10 10:26:36 PM UTC 2024	approved	👍 tarball `eessi-2023.06-software-linux-aarch64-generic-1712780360.tar.gz` approved, see PR https://github.com/NorESSI/2024-staging/pull/116
Apr 10 10:28:51 PM UTC 2024	ingested	🎉 tarball `eessi-2023.06-software-linux-aarch64-generic-1712780360.tar.gz` successfully ingested at `2023.06/software/linux/aarch64/generic/`

trz42 · 2024-04-10T20:42:35Z

Checklist before starting deployment (setting bot:deploy label):

Check if the SPDX license identifier is provided
Check whether builds for all required architectures succeed (SUCCESS message + reasonably sized tarball)
Check if the PR is up-to-date with the target branch nessi.no-2023.06 in the repository (if not what are the differences)
Assess if all requested changes are sound (checking files changed on GitHub.com)
Verify that all easyconfig/s being built are included with the EB version used (if not why not)
Review changes (if any) needed to get the build(s) succeed (common changes for all architectures, changes for a single architecture, changes because of build environment specifics, etc.)

trz42 · 2024-04-10T20:53:30Z

Target architectures

x86_64-intel-broadwell
x86_64-intel-skylake_avx512
x86_64-amd-zen2
x86_64-generic
aarch64-generic

Checklist for deployment/ingestion

at least one tarball for each architecture has been uploaded
- two tarballs for aarch64/generic (despite one FAILURE for build on AWS)
- first upload from eX3 failed
- second upload from eX3 failed
- several attempts failed
  - put workaround in place that uploads files from a compute node which apparently instantly connects to the Minio server
at least one tarball for each architecture has been staged
for each staged tarball was a PR for approval/rejection opened
for each architecture one and only one tarball has been approved
for each architecture one and only one tarball was ingested
all tests in the CI have succeeded (rerun failed tests ~ 10 mins after last ingest)
has the package become available via CernVM-FS for all architectures ingested (for lmod cache updates pay attention to timestamp of files)

command & log

command

cd /cvmfs/pilot.nessi.no/versions/2023.06/software/linux ; \
ls -l \
      x86_64/{generic,amd/zen2,intel/[bsc]*}/{software,modules/all}/EasyBuild/4.9.1* \
      aarch64/generic/{software,modules/all}/EasyBuild/4.9.1*

log

-rw-r--r--. 1 cvmfs cvmfs 1223 Apr 10 20:16 aarch64/generic/modules/all/EasyBuild/4.9.1.lua
-rw-rw-r--. 1 cvmfs cvmfs 1222 Apr 10 19:42 x86_64/amd/zen2/modules/all/EasyBuild/4.9.1.lua
-rw-rw-r--. 1 cvmfs cvmfs 1221 Apr 10 19:42 x86_64/generic/modules/all/EasyBuild/4.9.1.lua
-rw-rw-r--. 1 cvmfs cvmfs 1229 Apr 10 19:40 x86_64/intel/broadwell/modules/all/EasyBuild/4.9.1.lua
-rw-rw-r--. 1 cvmfs cvmfs 1234 Apr 10 19:41 x86_64/intel/skylake_avx512/modules/all/EasyBuild/4.9.1.lua

aarch64/generic/software/EasyBuild/4.9.1:
total 23
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 20:15 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 20:15 contrib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 Apr 10 20:18 easybuild
dr-xr-xr-x. 2 cvmfs cvmfs 4096 Apr 10 20:15 etc
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 20:15 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 Apr 10 20:16 lib64 -> lib

x86_64/amd/zen2/software/EasyBuild/4.9.1:
total 23
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:41 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:41 contrib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 Apr 10 19:42 easybuild
dr-xr-xr-x. 2 cvmfs cvmfs 4096 Apr 10 19:41 etc
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:41 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 Apr 10 19:41 lib64 -> lib

x86_64/generic/software/EasyBuild/4.9.1:
total 23
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:41 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:41 contrib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 Apr 10 19:42 easybuild
dr-xr-xr-x. 2 cvmfs cvmfs 4096 Apr 10 19:41 etc
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:41 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 Apr 10 19:41 lib64 -> lib

x86_64/intel/broadwell/software/EasyBuild/4.9.1:
total 23
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:40 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:40 contrib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 Apr 10 19:41 easybuild
dr-xr-xr-x. 2 cvmfs cvmfs 4096 Apr 10 19:40 etc
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:40 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 Apr 10 19:40 lib64 -> lib

x86_64/intel/skylake_avx512/software/EasyBuild/4.9.1:
total 23
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:40 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:40 contrib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 Apr 10 19:42 easybuild
dr-xr-xr-x. 2 cvmfs cvmfs 4096 Apr 10 19:40 etc
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:40 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 Apr 10 19:41 lib64 -> lib

poksumdo

All ingested. Will be interesting to see if workaround on eX3 works from bot too. (For this PR the upload script was run from the command line.)

{2023.06}[system] EasyBuild v4.9.1

a9261c9

trz42 added the NESSI/2023.06 label Apr 10, 2024

trz42 mentioned this pull request Apr 10, 2024

Syncing code-base and CVMFS repository with EESSI (April 2024) #294

Open

51 tasks

trz42 added bot:deploy and removed bot:deploy labels Apr 10, 2024

poksumdo approved these changes Apr 10, 2024

View reviewed changes

poksumdo merged commit cc6c6a6 into NorESSI:nessi.no-2023.06 Apr 10, 2024
25 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

{2023.06}[system] EasyBuild v4.9.1 #314

{2023.06}[system] EasyBuild v4.9.1 #314

trz42 commented Apr 10, 2024 •

edited

Loading

trz42 commented Apr 10, 2024

nessi-bot bot commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited by trz42

Loading

nessi-bot bot commented Apr 10, 2024 •

edited by trz42

Loading

nessi-bot bot commented Apr 10, 2024 •

edited by trz42

Loading

nessi-bot bot commented Apr 10, 2024 •

edited by trz42

Loading

nessi-bot bot commented Apr 10, 2024

nessi-bot bot commented Apr 10, 2024

nessi-bot bot commented Apr 10, 2024

nessi-bot bot commented Apr 10, 2024

nessi-bot bot commented Apr 10, 2024 •

edited by trz42

Loading

trz42 commented Apr 10, 2024

nessi-bot bot commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited by trz42

Loading

trz42 commented Apr 10, 2024 •

edited

Loading

trz42 commented Apr 10, 2024 •

edited by poksumdo

Loading

poksumdo left a comment

{2023.06}[system] EasyBuild v4.9.1 #314

{2023.06}[system] EasyBuild v4.9.1 #314

Conversation

trz42 commented Apr 10, 2024 • edited Loading

trz42 commented Apr 10, 2024

nessi-bot bot commented Apr 10, 2024 • edited Loading

nessi-bot bot commented Apr 10, 2024 • edited Loading

nessi-bot bot commented Apr 10, 2024 • edited Loading

nessi-bot bot commented Apr 10, 2024 • edited Loading

nessi-bot bot commented Apr 10, 2024 • edited by trz42 Loading

nessi-bot bot commented Apr 10, 2024 • edited by trz42 Loading

nessi-bot bot commented Apr 10, 2024 • edited by trz42 Loading

nessi-bot bot commented Apr 10, 2024 • edited by trz42 Loading

nessi-bot bot commented Apr 10, 2024

nessi-bot bot commented Apr 10, 2024

nessi-bot bot commented Apr 10, 2024

nessi-bot bot commented Apr 10, 2024

nessi-bot bot commented Apr 10, 2024 • edited by trz42 Loading

trz42 commented Apr 10, 2024

nessi-bot bot commented Apr 10, 2024 • edited Loading

nessi-bot bot commented Apr 10, 2024 • edited Loading

nessi-bot bot commented Apr 10, 2024 • edited Loading

nessi-bot bot commented Apr 10, 2024 • edited Loading

nessi-bot bot commented Apr 10, 2024 • edited by trz42 Loading

trz42 commented Apr 10, 2024 • edited Loading

trz42 commented Apr 10, 2024 • edited by poksumdo Loading

poksumdo left a comment

Choose a reason for hiding this comment

trz42 commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited by trz42

Loading

nessi-bot bot commented Apr 10, 2024 •

edited by trz42

Loading

nessi-bot bot commented Apr 10, 2024 •

edited by trz42

Loading

nessi-bot bot commented Apr 10, 2024 •

edited by trz42

Loading

nessi-bot bot commented Apr 10, 2024 •

edited by trz42

Loading

nessi-bot bot commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited

Loading

nessi-bot bot commented Apr 10, 2024 •

edited by trz42

Loading

trz42 commented Apr 10, 2024 •

edited

Loading

trz42 commented Apr 10, 2024 •

edited by poksumdo

Loading