-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
{2023.06}[foss/2023b] Qt5 v5.15.13 #332
{2023.06}[foss/2023b] Qt5 v5.15.13 #332
Conversation
Instance
|
Instance
|
Instance
|
Instance
|
bot: build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell |
Updates by the bot instance
|
Updates by the bot instance
|
Updates by the bot instance
|
Updates by the bot instance
|
New job on instance
|
New job on instance
|
New job on instance
|
New job on instance
|
New job on instance
|
Just retrying with bot: build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic |
Updates by the bot instance
|
Updates by the bot instance
|
Updates by the bot instance
|
Updates by the bot instance
|
New job on instance
|
…into nessi-2023.06-qt5-5.15.13-2023b
Rebuild after #335 bot: build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell |
Updates by the bot instance
|
Updates by the bot instance
|
Updates by the bot instance
|
Updates by the bot instance
|
New job on instance
|
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic |
Updates by the bot instance
|
Updates by the bot instance
|
Updates by the bot instance
|
Updates by the bot instance
|
|
…into nessi-2023.06-qt5-5.15.13-2023b
Try building it on bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic |
Updates by the bot instance
|
Updates by the bot instance
|
Updates by the bot instance
|
New job on instance
|
Updates by the bot instance
|
Complete rebuild... bot: build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell |
Updates by the bot instance
|
Updates by the bot instance
|
Updates by the bot instance
|
New job on instance
|
New job on instance
|
New job on instance
|
New job on instance
|
Updates by the bot instance
|
New job on instance
|
Checklist before starting deployment (setting
|
Target architectures
Checklist for deployment/ingestion
command & logcommand BASE_DIR=/cvmfs/pilot.nessi.no/versions/2023.06/software/linux \
ARCHS=() \
ARCHS+=("aarch64/generic") ; \
ARCHS+=("x86_64/generic") ; \
ARCHS+=("x86_64/amd/zen2") ; \
ARCHS+=("x86_64/intel/broadwell") ; \
ARCHS+=("x86_64/intel/skylake_avx512") ; \
for arch in "${ARCHS[@]}"; do \
ls -l \
${BASE_DIR}/${arch}/{software,modules/all}/Qt5/5.15.13-GCCcore-13.2.0* ; \
done ; \
ls -l \
${BASE_DIR}/../../init/easybuild/eb_hooks.py log - BEFORE ingestion ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/software/Qt5/5.15.13-GCCcore-13.2.0*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/modules/all/Qt5/5.15.13-GCCcore-13.2.0*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/software/Qt5/5.15.13-GCCcore-13.2.0*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/modules/all/Qt5/5.15.13-GCCcore-13.2.0*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/software/Qt5/5.15.13-GCCcore-13.2.0*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all/Qt5/5.15.13-GCCcore-13.2.0*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/software/Qt5/5.15.13-GCCcore-13.2.0*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/modules/all/Qt5/5.15.13-GCCcore-13.2.0*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/Qt5/5.15.13-GCCcore-13.2.0*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all/Qt5/5.15.13-GCCcore-13.2.0*': No such file or directory
-rw-rw-r-- 1 cvmfs cvmfs 43825 May 30 11:45 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/../../init/easybuild/eb_hooks.py log - AFTER ingestion -rw-rw-r-- 1 cvmfs cvmfs 2732 Jun 2 21:49 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/modules/all/Qt5/5.15.13-GCCcore-13.2.0.lua
/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/software/Qt5/5.15.13-GCCcore-13.2.0:
total 59
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 21:47 bin
dr-xr-xr-x 4 cvmfs cvmfs 4096 Jun 2 21:42 doc
dr-xr-xr-x 3 cvmfs cvmfs 4096 Jun 2 21:49 easybuild
dr-xr-xr-x 53 cvmfs cvmfs 4096 Jun 2 21:48 examples
dr-xr-xr-x 98 cvmfs cvmfs 4096 Jun 2 21:48 include
dr-xr-xr-x 5 cvmfs cvmfs 4096 Jun 2 21:48 lib
lrwxrwxrwx 1 cvmfs cvmfs 3 Jun 2 21:48 lib64 -> lib
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 21:47 libexec
dr-xr-xr-x 76 cvmfs cvmfs 4096 Jun 2 21:43 mkspecs
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 21:47 phrasebooks
dr-xr-xr-x 28 cvmfs cvmfs 4096 Jun 2 21:48 plugins
dr-xr-xr-x 25 cvmfs cvmfs 4096 Jun 2 21:48 qml
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 21:47 resources
dr-xr-xr-x 3 cvmfs cvmfs 4096 Jun 2 21:48 translations
-rw-rw-r-- 1 cvmfs cvmfs 2731 Jun 2 22:59 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/modules/all/Qt5/5.15.13-GCCcore-13.2.0.lua
/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/software/Qt5/5.15.13-GCCcore-13.2.0:
total 59
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 22:58 bin
dr-xr-xr-x 4 cvmfs cvmfs 4096 Jun 2 22:52 doc
dr-xr-xr-x 3 cvmfs cvmfs 4096 Jun 2 23:00 easybuild
dr-xr-xr-x 53 cvmfs cvmfs 4096 Jun 2 22:58 examples
dr-xr-xr-x 98 cvmfs cvmfs 4096 Jun 2 22:58 include
dr-xr-xr-x 5 cvmfs cvmfs 4096 Jun 2 22:58 lib
lrwxrwxrwx 1 cvmfs cvmfs 3 Jun 2 22:58 lib64 -> lib
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 22:58 libexec
dr-xr-xr-x 76 cvmfs cvmfs 4096 Jun 2 22:52 mkspecs
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 22:57 phrasebooks
dr-xr-xr-x 28 cvmfs cvmfs 4096 Jun 2 22:58 plugins
dr-xr-xr-x 25 cvmfs cvmfs 4096 Jun 2 22:58 qml
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 22:58 resources
dr-xr-xr-x 3 cvmfs cvmfs 4096 Jun 2 22:58 translations
-rw-rw-r-- 1 cvmfs cvmfs 2732 Jun 2 22:30 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all/Qt5/5.15.13-GCCcore-13.2.0.lua
/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/software/Qt5/5.15.13-GCCcore-13.2.0:
total 59
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 22:28 bin
dr-xr-xr-x 4 cvmfs cvmfs 4096 Jun 2 22:20 doc
dr-xr-xr-x 3 cvmfs cvmfs 4096 Jun 2 22:30 easybuild
dr-xr-xr-x 53 cvmfs cvmfs 4096 Jun 2 22:29 examples
dr-xr-xr-x 98 cvmfs cvmfs 4096 Jun 2 22:28 include
dr-xr-xr-x 5 cvmfs cvmfs 4096 Jun 2 22:28 lib
lrwxrwxrwx 1 cvmfs cvmfs 3 Jun 2 22:29 lib64 -> lib
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 22:28 libexec
dr-xr-xr-x 76 cvmfs cvmfs 4096 Jun 2 22:20 mkspecs
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 22:27 phrasebooks
dr-xr-xr-x 28 cvmfs cvmfs 4096 Jun 2 22:28 plugins
dr-xr-xr-x 25 cvmfs cvmfs 4096 Jun 2 22:28 qml
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 22:28 resources
dr-xr-xr-x 3 cvmfs cvmfs 4096 Jun 2 22:29 translations
-rw-rw-r-- 1 cvmfs cvmfs 2739 Jun 2 22:46 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/modules/all/Qt5/5.15.13-GCCcore-13.2.0.lua
/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/software/Qt5/5.15.13-GCCcore-13.2.0:
total 59
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 22:45 bin
dr-xr-xr-x 4 cvmfs cvmfs 4096 Jun 2 22:40 doc
dr-xr-xr-x 3 cvmfs cvmfs 4096 Jun 2 22:47 easybuild
dr-xr-xr-x 53 cvmfs cvmfs 4096 Jun 2 22:46 examples
dr-xr-xr-x 98 cvmfs cvmfs 4096 Jun 2 22:45 include
dr-xr-xr-x 5 cvmfs cvmfs 4096 Jun 2 22:45 lib
lrwxrwxrwx 1 cvmfs cvmfs 3 Jun 2 22:46 lib64 -> lib
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 22:45 libexec
dr-xr-xr-x 76 cvmfs cvmfs 4096 Jun 2 22:40 mkspecs
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 22:45 phrasebooks
dr-xr-xr-x 28 cvmfs cvmfs 4096 Jun 2 22:45 plugins
dr-xr-xr-x 25 cvmfs cvmfs 4096 Jun 2 22:45 qml
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 22:45 resources
dr-xr-xr-x 3 cvmfs cvmfs 4096 Jun 2 22:46 translations
-rw-rw-r-- 1 cvmfs cvmfs 2744 Jun 2 23:21 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all/Qt5/5.15.13-GCCcore-13.2.0.lua
/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/Qt5/5.15.13-GCCcore-13.2.0:
total 59
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 23:19 bin
dr-xr-xr-x 4 cvmfs cvmfs 4096 Jun 2 23:09 doc
dr-xr-xr-x 3 cvmfs cvmfs 4096 Jun 2 23:22 easybuild
dr-xr-xr-x 53 cvmfs cvmfs 4096 Jun 2 23:20 examples
dr-xr-xr-x 98 cvmfs cvmfs 4096 Jun 2 23:20 include
dr-xr-xr-x 5 cvmfs cvmfs 4096 Jun 2 23:20 lib
lrwxrwxrwx 1 cvmfs cvmfs 3 Jun 2 23:20 lib64 -> lib
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 23:19 libexec
dr-xr-xr-x 76 cvmfs cvmfs 4096 Jun 2 23:09 mkspecs
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 23:18 phrasebooks
dr-xr-xr-x 28 cvmfs cvmfs 4096 Jun 2 23:20 plugins
dr-xr-xr-x 25 cvmfs cvmfs 4096 Jun 2 23:20 qml
dr-xr-xr-x 2 cvmfs cvmfs 4096 Jun 2 23:19 resources
dr-xr-xr-x 3 cvmfs cvmfs 4096 Jun 2 23:20 translations
-rw-rw-r-- 1 cvmfs cvmfs 45790 Jun 2 19:49 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/../../init/easybuild/eb_hooks.py |
Need to double-check and possibly fix contents of ingested $ diff -u /cluster/projects/nn9992k/eb_hooks.py /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/../../init/easybuild/eb_hooks.py
--- /cluster/projects/nn9992k/eb_hooks.py 2024-06-02 23:56:06.000000000 +0200
+++ /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/../../init/easybuild/eb_hooks.py 2024-06-02 19:49:35.000000000 +0200
@@ -425,6 +425,29 @@
raise EasyBuildError("OpenBLAS-specific hook triggered for non-OpenBLAS easyconfig?!")
+def pre_configure_hook_pytorch_add_cupti_libdir(self, *args, **kwargs):
+ """
+ Pre-configure hook for PyTorch: add directory $EESSI_SOFTWARE_PATH/software/CUDA/12.1.1/extras/CUPTI/lib64 to LIBRARY_PATH
+ """
+ if self.name == 'PyTorch':
+ if 'cudaver' in self.cfg.template_values and self.cfg.template_values['cudaver'] == '12.1.1':
+ _cudaver = self.cfg.template_values['cudaver']
+ print_msg("pre_configure_hook_pytorch_add_cupti_libdir: CUDA version: '%s'" % _cudaver)
+ _library_path = os.getenv('LIBRARY_PATH')
+ print_msg("pre_configure_hook_pytorch_add_cupti_libdir: library_path: '%s'", _library_path)
+ _eessi_software_path = os.getenv('EESSI_SOFTWARE_PATH')
+ print_msg("pre_configure_hook_pytorch_add_cupti_libdir: eessi_software_path: '%s'", _eessi_software_path)
+ _cupti_lib_dir = os.path.join(_eessi_software_path, 'software', 'CUDA', _cudaver, 'extras', 'CUPTI', 'lib64')
+ print_msg("pre_configure_hook_pytorch_add_cupti_libdir: cupti_lib_dir: '%s'", _cupti_lib_dir)
+ if _library_path:
+ env.setvar('LIBRARY_PATH', ':'.join([_library_path, _cupti_lib_dir]))
+ else:
+ env.setvar('LIBRARY_PATH', _cupti_lib_dir)
+ print_msg("pre_configure_hook_pytorch_add_cupti_libdir: LIBRARY_PATH: '%s'", os.getenv('LIBRARY_PATH'))
+ else:
+ raise EasyBuildError("PyTorch-specific hook triggered for non-PyTorch easyconfig?!")
+
+
def pre_configure_hook_libfabric_disable_psm3_x86_64_generic(self, *args, **kwargs):
"""Add --disable-psm3 to libfabric configure options when building with --optarch=GENERIC on x86_64."""
if self.name == 'libfabric':
@@ -560,6 +583,12 @@
"""
if self.name == 'PyTorch' and self.version == '2.1.2' and get_cpu_architecture() == AARCH64:
self.cfg['max_failed_tests'] = 10
+ if 'cudaver' in self.cfg.template_values and self.cfg.template_values['cudaver'] == '12.1.1':
+ _cudaver = self.cfg.template_values['cudaver']
+ _runtest = self.cfg['runtest']
+ self.cfg['runtest'] = _runtest.replace(
+ 'PYTHONUNBUFFERED',
+ 'PYTORCH_TEST_RUN_EVERYTHING_IN_SERIAL=1 PYTHONUNBUFFERED')
def pre_single_extension_hook(ext, *args, **kwargs):
@@ -851,6 +880,7 @@
'libfabric': pre_configure_hook_libfabric_disable_psm3_x86_64_generic,
'MetaBAT': pre_configure_hook_metabat_filtered_zlib_dep,
'OpenBLAS': pre_configure_hook_openblas_optarch_generic,
+ 'PyTorch': pre_configure_hook_pytorch_add_cupti_libdir,
'WRF': pre_configure_hook_wrf_aarch64,
'at-spi2-core': pre_configure_hook_atspi2core_filter_ld_library_path,
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Finally.
Sync NESSI with EESSI (PR 462).
SPDX license identifier:
LGPL-3.0-or-later
Missing packages: