another apptainer workaround [13_2_X]

[kpedro88]

backport of #45652

[cmsbuild]

A new Pull Request was created by @kpedro88 for CMSSW_13_2_X.

It involves the following packages:

• HeterogeneousCore/SonicTriton (heterogeneous)

@cmsbuild, @fwyzard, @makortel can you please review it and eventually sign? Thanks.
@makortel, @missirol, @riga, @rovere this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

• Backported from another apptainer workaround #45652

[cmsbuild]

cms-bot internal usage

[kpedro88]

test parameters
workflows = 10804.31

[kpedro88]

please test

[makortel]

Thanks @kpedro88. I see we'd need the backport also in

• 13_3_X
• 13_1_X
• 13_0_X
• 12_6_X
• 12_4_X

Although we could discuss if some of these earlier release cycles, e.g. those below, could be dropped

• 13_3_X: latest release 13_3_3 built on 2024-02-21 (although there are commits in 13_3_X branch after that release)
• 12_6_X: latest release 12_6_5 built on 2023-06-07 (although there are commits in 12_6_X branch after that release)

Assuming 13_2_X and 13_1_X release cycles would still need to be kept, maybe we could consider stopping slc7 builds for them? At this point I'd expect the probability to have do IgProf memory profiling on them to be negligible.

Maybe something we could discuss in the ORP next week? @cms-sw/orp-l2 @smuzaffar

[smuzaffar]

Maybe something we could discuss in the ORP next week? @cms-sw/orp-l2 @smuzaffar

sounds good.
@kpedro88 , isn't this already fixed for apptainer 1.3.2 apptainer/apptainer#2220 , apptainer/apptainer#2234 ?

[kpedro88]

It's supposed to be fixed, but we are still encountering problems with it. Apptainer no longer wants to support sl7, so I think we just have to rely on ourselves at this point. I am preparing all of the possible backports and will submit them (before going on vacation for several weeks), and then core/ORP can decide which ones to merge.

[kpedro88]

#45719
#45720
#45721
#45722
#45723

[cmsbuild]

+1

Size: This PR adds an extra 12KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-b77d0b/40973/summary.html
COMMIT: 1071497
CMSSW: CMSSW_13_2_X_2024-08-14-2300/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/45710/40973/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• You potentially added 6 lines to the logs
• Reco comparison results: 14 differences found in the comparisons
• DQMHistoTests: Total files compared: 49
• DQMHistoTests: Total histograms compared: 3301436
• DQMHistoTests: Total failures: 15
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3301399
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
• Checked 213 log files, 164 edm output root files, 49 DQM output files
• TriggerResults: no differences found

[makortel]

+heterogeneous

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next CMSSW_13_2_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_14_1_X is complete. This pull request will now be reviewed by the release team before it's merged. @antoniovilela, @sextonkennedy, @rappoccio, @mandrenguyen (and backports should be raised in the release meeting by the corresponding L2)

[mandrenguyen]

+1