Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

{2023.06} Rebuilds of hatchling and Python for Sapphire Rapids #933

Conversation

bedroge
Copy link
Collaborator

@bedroge bedroge commented Feb 23, 2025

No description provided.

@bedroge bedroge added 2023.06-software.eessi.io 2023.06 version of software.eessi.io sapphirerapids labels Feb 23, 2025
Copy link

eessi-bot bot commented Feb 23, 2025

Instance eessi-bot-mc-aws is configured to build for:

  • architectures: x86_64/generic, x86_64/intel/haswell, x86_64/intel/sapphirerapids, x86_64/intel/skylake_avx512, x86_64/amd/zen2, x86_64/amd/zen3, aarch64/generic, aarch64/neoverse_n1, aarch64/neoverse_v1
  • repositories: eessi.io-2023.06-compat, eessi.io-2023.06-software

Copy link

eessi-bot bot commented Feb 23, 2025

Instance eessi-bot-mc-azure is configured to build for:

  • architectures: x86_64/amd/zen4
  • repositories: eessi.io-2023.06-software, eessi.io-2023.06-compat

@eessi-bot-surf
Copy link

Instance eessi-bot-surf is configured to build for:

  • architectures: x86_64/amd/zen4, x86_64/amd/zen2
  • repositories: eessi.io-2023.06-compat, eessi.io-2023.06-software, eessi-hpc.org-2023.06-software, eessi-hpc.org-2023.06-compat

@gpu-bot-ugent
Copy link

gpu-bot-ugent bot commented Feb 23, 2025

Instance eessi-bot-vsc-ugent is configured to build for:

  • architectures: x86_64/amd/zen3
  • repositories: eessi-hpc.org-2023.06-compat, eessi.io-2023.06-software, eessi-hpc.org-2023.06-software, eessi.io-2023.06-compat

@eessi-bot-toprichard
Copy link

Instance rt-Grace-jr is configured to build for:

  • architectures: aarch64/nvidia/grace
  • repositories: eessi.io-2023.06-software

@bedroge
Copy link
Collaborator Author

bedroge commented Feb 23, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:sapphirerapids

Copy link

eessi-bot bot commented Feb 23, 2025

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:sapphirerapids from bedroge

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids
  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids resulted in:

Copy link

eessi-bot bot commented Feb 23, 2025

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:sapphirerapids from bedroge

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids
  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids resulted in:

    • no jobs were submitted

@gpu-bot-ugent
Copy link

gpu-bot-ugent bot commented Feb 23, 2025

Updates by the bot instance eessi-bot-vsc-ugent (click for details)
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:sapphirerapids from bedroge

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids
  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids resulted in:

    • no jobs were submitted

@eessi-bot-toprichard
Copy link

Updates by the bot instance rt-Grace-jr (click for details)
  • account bedroge has NO permission to send commands to the bot

Copy link

eessi-bot bot commented Feb 23, 2025

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-intel-sapphirerapids for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2025.02/pr_933/47428

date job status comment
Feb 23 20:00:16 UTC 2025 submitted job id 47428 awaits release by job manager
Feb 23 20:00:28 UTC 2025 released job awaits launch by Slurm scheduler
Feb 23 20:06:30 UTC 2025 running job 47428 is running
Feb 23 20:46:11 UTC 2025 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-47428.out
✅ no message matching FATAL:
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-sapphirerapids-1740343020.tar.gzsize: 222 MiB (232941710 bytes)
entries: 20563
modules under 2023.06/software/linux/x86_64/intel/sapphirerapids/modules/all
hatchling/1.18.0-GCCcore-13.2.0.lua
Python/3.11.3-GCCcore-12.3.0.lua
Python/3.11.5-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/intel/sapphirerapids/software
hatchling/1.18.0-GCCcore-13.2.0
Python/3.11.3-GCCcore-12.3.0
Python/3.11.5-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/intel/sapphirerapids
no other files in tarball
Feb 23 20:46:11 UTC 2025 test result
😢 FAILURE (click triangle for details)
Reason
EESSI test suite was not run, test step itself failed to execute.
Details
✅ job output file slurm-47428.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@eessi-bot-surf
Copy link

Updates by the bot instance eessi-bot-surf (click for details)
  • account bedroge has NO permission to send commands to the bot

@bedroge
Copy link
Collaborator Author

bedroge commented Feb 23, 2025

Permission issue. Changed the permissions on the easybuild subdir of hatchling, let's try again...

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:sapphirerapids

Copy link

eessi-bot bot commented Feb 23, 2025

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:sapphirerapids from bedroge

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids
  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids resulted in:

Copy link

eessi-bot bot commented Feb 23, 2025

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:sapphirerapids from bedroge

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids
  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids resulted in:

    • no jobs were submitted

@eessi-bot-surf
Copy link

Updates by the bot instance eessi-bot-surf (click for details)
  • account bedroge has NO permission to send commands to the bot

@eessi-bot-toprichard
Copy link

Updates by the bot instance rt-Grace-jr (click for details)
  • account bedroge has NO permission to send commands to the bot

Copy link

eessi-bot bot commented Feb 23, 2025

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-intel-sapphirerapids for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2025.02/pr_933/47429

date job status comment
Feb 23 20:51:29 UTC 2025 submitted job id 47429 awaits release by job manager
Feb 23 20:52:14 UTC 2025 released job awaits launch by Slurm scheduler
Feb 23 20:53:16 UTC 2025 running job 47429 is running
Feb 23 21:32:56 UTC 2025 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-47429.out
✅ no message matching FATAL:
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-sapphirerapids-1740345773.tar.gzsize: 222 MiB (232968711 bytes)
entries: 20563
modules under 2023.06/software/linux/x86_64/intel/sapphirerapids/modules/all
hatchling/1.18.0-GCCcore-13.2.0.lua
Python/3.11.3-GCCcore-12.3.0.lua
Python/3.11.5-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/intel/sapphirerapids/software
hatchling/1.18.0-GCCcore-13.2.0
Python/3.11.3-GCCcore-12.3.0
Python/3.11.5-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/intel/sapphirerapids
no other files in tarball
Feb 23 21:32:56 UTC 2025 test result
😢 FAILURE (click triangle for details)
Reason
EESSI test suite was not run, test step itself failed to execute.
Details
✅ job output file slurm-47429.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@gpu-bot-ugent
Copy link

gpu-bot-ugent bot commented Feb 23, 2025

Updates by the bot instance eessi-bot-vsc-ugent (click for details)
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:sapphirerapids from bedroge

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids
  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids resulted in:

    • no jobs were submitted

@bedroge
Copy link
Collaborator Author

bedroge commented Feb 23, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:sapphirerapids

Copy link

eessi-bot bot commented Feb 23, 2025

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:sapphirerapids from bedroge

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids
  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids resulted in:

Copy link

eessi-bot bot commented Feb 23, 2025

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:sapphirerapids from bedroge

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids
  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids resulted in:

    • no jobs were submitted

@eessi-bot-surf
Copy link

Updates by the bot instance eessi-bot-surf (click for details)
  • account bedroge has NO permission to send commands to the bot

@gpu-bot-ugent
Copy link

gpu-bot-ugent bot commented Feb 23, 2025

Updates by the bot instance eessi-bot-vsc-ugent (click for details)
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:sapphirerapids from bedroge

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids
  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:sapphirerapids resulted in:

    • no jobs were submitted

@eessi-bot-toprichard
Copy link

Updates by the bot instance rt-Grace-jr (click for details)
  • account bedroge has NO permission to send commands to the bot

Copy link

eessi-bot bot commented Feb 23, 2025

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-intel-sapphirerapids for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2025.02/pr_933/47430

date job status comment
Feb 23 22:25:13 UTC 2025 submitted job id 47430 awaits release by job manager
Feb 23 22:26:02 UTC 2025 released job awaits launch by Slurm scheduler
Feb 23 22:27:04 UTC 2025 running job 47430 is running
Feb 23 23:39:18 UTC 2025 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-47430.out
✅ no message matching FATAL:
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-sapphirerapids-1740353327.tar.gzsize: 333 MiB (349662828 bytes)
entries: 44589
modules under 2023.06/software/linux/x86_64/intel/sapphirerapids/modules/all
hatchling/1.18.0-GCCcore-12.3.0.lua
hatchling/1.18.0-GCCcore-13.2.0.lua
Python/3.11.3-GCCcore-12.3.0.lua
Python/3.11.5-GCCcore-13.2.0.lua
Python-bundle-PyPI/2023.06-GCCcore-12.3.0.lua
Python-bundle-PyPI/2023.10-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/intel/sapphirerapids/software
hatchling/1.18.0-GCCcore-12.3.0
hatchling/1.18.0-GCCcore-13.2.0
Python/3.11.3-GCCcore-12.3.0
Python/3.11.5-GCCcore-13.2.0
Python-bundle-PyPI/2023.06-GCCcore-12.3.0
Python-bundle-PyPI/2023.10-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/intel/sapphirerapids
no other files in tarball
Feb 23 23:39:18 UTC 2025 test result
😢 FAILURE (click triangle for details)
Reason
EESSI test suite was not run, test step itself failed to execute.
Details
✅ job output file slurm-47430.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
Feb 24 07:01:29 UTC 2025 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-sapphirerapids-1740353327.tar.gz to S3 bucket succeeded

@bedroge bedroge added the ready-to-deploy Mark a PR as ready to deploy label Feb 24, 2025
@boegel boegel added bot:deploy Ask bot to deploy missing software installations to EESSI and removed ready-to-deploy Mark a PR as ready to deploy labels Feb 24, 2025
@eessi-bot-surf
Copy link

Label bot:deploy has been set by user boegel, but this person does not have permission to trigger deployments

1 similar comment
@eessi-bot-toprichard
Copy link

Label bot:deploy has been set by user boegel, but this person does not have permission to trigger deployments

@boegel
Copy link
Contributor

boegel commented Feb 24, 2025

staging PR merged

@boegel boegel merged commit b7706da into EESSI:2023.06-software.eessi.io Feb 24, 2025
49 checks passed
Copy link

eessi-bot bot commented Feb 24, 2025

PR merged! Moved ['/project/def-users/SHARED/jobs/2025.02/pr_933/47428', '/project/def-users/SHARED/jobs/2025.02/pr_933/47429', '/project/def-users/SHARED/jobs/2025.02/pr_933/47430'] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2025.02.24

Copy link

eessi-bot bot commented Feb 24, 2025

PR merged! Moved [] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2025.02.24

@gpu-bot-ugent
Copy link

gpu-bot-ugent bot commented Feb 24, 2025

PR merged! Moved [] to /scratch/gent/vo/002/gvo00211/SHARED/trash_bin/EESSI/software-layer/2025.02.24

@bedroge bedroge deleted the sapphirerapids_hatchling_python_rebuilds branch February 24, 2025 08:10
@bedroge
Copy link
Collaborator Author

bedroge commented Feb 24, 2025

Cleaned up the old installations (and reingested the new ones) with:

cvmfs_server transaction software.eessi.io

rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/sapphire_rapids/software/hatchling/1.18.0-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/sapphire_rapids/software/hatchling/1.18.0-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/sapphire_rapids/software/Python/3.11.3-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/sapphire_rapids/software/Python/3.11.5-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/sapphire_rapids/software/Python-bundle-PyPI/2023.06-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/sapphire_rapids/software/Python-bundle-PyPI/2023.10-GCCcore-13.2.0

cd /cvmfs/software.eessi.io/versions

tar -xzf /srv/tmp/tarballs/eessi-2023.06-software-linux-x86_64-intel-sapphirerapids-1740353327.tar.gz

cd

cvmfs_server diff --worktree software.eessi.io > PR933-diff.txt
cvmfs_server publish -m "rebuilds of hatchling+Python+Python-bundle-PyPI for sapphirerapids, PR 933" software.eessi.io

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
2023.06-software.eessi.io 2023.06 version of software.eessi.io bot:deploy Ask bot to deploy missing software installations to EESSI sapphirerapids
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants