Add accelerator detection to Lmod version of EESSI initialisation #781

ocaisa · 2024-10-11T15:44:00Z

Requires

Put a Lmod-relevant wrapper in place for archdetect accelerator detection #783

eessi-bot · 2024-10-11T15:44:04Z

Instance eessi-bot-mc-aws is configured to build for:

architectures: x86_64/generic, x86_64/intel/haswell, x86_64/intel/skylake_avx512, x86_64/amd/zen2, x86_64/amd/zen3, aarch64/generic, aarch64/neoverse_n1, aarch64/neoverse_v1
repositories: eessi.io-2023.06-compat, eessi-hpc.org-2023.06-software, eessi-hpc.org-2023.06-compat, eessi.io-2023.06-software

eessi-bot · 2024-10-11T15:44:05Z

Instance eessi-bot-mc-azure is configured to build for:

architectures: x86_64/amd/zen4
repositories: eessi-hpc.org-2023.06-software, eessi-hpc.org-2023.06-compat, eessi.io-2023.06-software, eessi.io-2023.06-compat

init/modules/EESSI/2023.06.lua

…o lmod_gpu

… original state

ocaisa · 2024-10-15T20:00:42Z

@boegel You are probably best placed to review this. I've added a lot of new CI which caught a few problems (in particular unloading the module did not unset a range of environment variables). There is also a check which compares the environment available via the module to that given by the init script.

I've also added a debug mode which can be used to print additional information.

ocaisa · 2024-10-15T20:32:11Z

bot: build repo:eessi.io-2023.06-software arch:x86_64/generic

eessi-bot · 2024-10-15T20:32:14Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:x86_64/generic from ocaisa
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/generic
handling command build repository:eessi.io-2023.06-software architecture:x86_64/generic resulted in:
- submitted job 23406, for details & status see Add accelerator detection to Lmod version of EESSI initialisation #781 (comment)

eessi-build-deploy-bot-deucalion · 2024-10-15T20:32:14Z

Updates by the bot instance boegel-bot-deucalion (click for details)

account ocaisa has NO permission to send commands to the bot

eessi-bot · 2024-10-15T20:32:15Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:x86_64/generic from ocaisa
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/generic
handling command build repository:eessi.io-2023.06-software architecture:x86_64/generic resulted in:
- no jobs were submitted

eessi-bot · 2024-10-15T20:32:18Z

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.10/pr_781/23406

date	job status	comment
Oct 15 20:32:17 UTC 2024	submitted	job id `23406` awaits release by job manager
Oct 15 20:32:41 UTC 2024	released	job awaits launch by Slurm scheduler
Oct 15 20:37:56 UTC 2024	running	job `23406` is running
Oct 15 20:48:29 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-23406.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-generic-1729024910.tar.gz` size: 0 MiB (2124 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/generic/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/generic/software no software packages in tarball other under 2023.06/software/linux/x86_64/generic `2023.06/init/modules/EESSI/2023.06.lua`
Oct 15 20:48:29 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ OK ] ( 1/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos /aeb2d9df @BotBuildTests:x86-64-generic-node+default P: perf: 486.589 timesteps/s (r:0, l:None, u:None) [ OK ] ( 2/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos /04ff9ece @BotBuildTests:x86-64-generic-node+default P: perf: 505.861 timesteps/s (r:0, l:None, u:None) [ OK ] ( 3/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /31ac6ab9 @BotBuildTests:x86-64-generic-node+default P: latency: 5.21 us (r:0, l:None, u:None) [ OK ] ( 4/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /f3be40a2 @BotBuildTests:x86-64-generic-node+default P: latency: 5.27 us (r:0, l:None, u:None) [ OK ] ( 5/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /10e66fba @BotBuildTests:x86-64-generic-node+default P: latency: 7.91 us (r:0, l:None, u:None) [ OK ] ( 6/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /5be57ae7 @BotBuildTests:x86-64-generic-node+default P: latency: 7.76 us (r:0, l:None, u:None) [ OK ] ( 7/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /c8c9aff5 @BotBuildTests:x86-64-generic-node+default P: latency: 0.71 us (r:0, l:None, u:None) [ OK ] ( 8/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /9795e491 @BotBuildTests:x86-64-generic-node+default P: latency: 0.61 us (r:0, l:None, u:None) [ OK ] ( 9/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /48da21c5 @BotBuildTests:x86-64-generic-node+default P: bandwidth: 10984.0 MB/s (r:0, l:None, u:None) [ OK ] (10/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /1b8c1ca2 @BotBuildTests:x86-64-generic-node+default P: bandwidth: 11009.13 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-23406.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

eessi-build-deploy-bot-deucalion · 2024-10-16T11:36:22Z

Updates by the bot instance boegel-bot-deucalion (click for details)

account ocaisa has NO permission to send commands to the bot

eessi-bot · 2024-10-16T11:36:22Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:x86_64/generic from ocaisa
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/generic
handling command build repository:eessi.io-2023.06-software architecture:x86_64/generic resulted in:
- no jobs were submitted

eessi-bot · 2024-10-16T11:36:26Z

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.10/pr_781/23592

date	job status	comment
Oct 16 11:36:25 UTC 2024	submitted	job id `23592` awaits release by job manager
Oct 16 11:37:20 UTC 2024	released	job awaits launch by Slurm scheduler
Oct 16 11:43:22 UTC 2024	running	job `23592` is running
Oct 16 11:53:34 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-23592.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-generic-1729079208.tar.gz` size: 0 MiB (2806 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/generic/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/generic/software no software packages in tarball other under 2023.06/software/linux/x86_64/generic `2023.06/init/modules/EESSI/2023.06.lua`
Oct 16 11:53:34 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ OK ] ( 1/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos /aeb2d9df @BotBuildTests:x86-64-generic-node+default P: perf: 483.768 timesteps/s (r:0, l:None, u:None) [ OK ] ( 2/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos /04ff9ece @BotBuildTests:x86-64-generic-node+default P: perf: 506.811 timesteps/s (r:0, l:None, u:None) [ OK ] ( 3/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /31ac6ab9 @BotBuildTests:x86-64-generic-node+default P: latency: 5.3 us (r:0, l:None, u:None) [ OK ] ( 4/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /f3be40a2 @BotBuildTests:x86-64-generic-node+default P: latency: 5.34 us (r:0, l:None, u:None) [ OK ] ( 5/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /10e66fba @BotBuildTests:x86-64-generic-node+default P: latency: 8.09 us (r:0, l:None, u:None) [ OK ] ( 6/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /5be57ae7 @BotBuildTests:x86-64-generic-node+default P: latency: 7.94 us (r:0, l:None, u:None) [ OK ] ( 7/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /c8c9aff5 @BotBuildTests:x86-64-generic-node+default P: latency: 0.71 us (r:0, l:None, u:None) [ OK ] ( 8/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /9795e491 @BotBuildTests:x86-64-generic-node+default P: latency: 0.64 us (r:0, l:None, u:None) [ OK ] ( 9/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /48da21c5 @BotBuildTests:x86-64-generic-node+default P: bandwidth: 10492.35 MB/s (r:0, l:None, u:None) [ OK ] (10/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /1b8c1ca2 @BotBuildTests:x86-64-generic-node+default P: bandwidth: 10503.85 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-23592.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

ocaisa · 2024-10-16T11:38:21Z

@casparvl @boegel Relevant tests are now passing again here (Lmod does things in the environment that make it hard to do a vanillla comparison).

This should be good to go, retriggered the build for deploy.

casparvl

I'm happy with the code and it works for... 99%. On our system, LMOD_PACKAGE_PATH is set. After loading & unloading the EESSI module, it is unset. So... not exactly the same environment as before :\

I don't know if there is an easy fix. If not, I'm happy to merge this as is - it's definitely a big improvement over what we had.

If we fix it, we should probably also put something like this in the CI tests (i.e. set LMOD_PACKAGE_PATH, load & unload EESSI, and do the env comparison before and after loading/unloading)

ocaisa · 2024-10-16T14:36:40Z

Switched to pushenv for LMOD_PACKAGE_PATH in 04c2573

ocaisa · 2024-10-16T14:38:31Z

I'm reluctant to put LMOD_PACKAGE_PATH into CI as it would need to be a sensible value if you are going to have it set when calling Lmod...and the only sensible one we have in CI is the one we ship with EESSI

ocaisa · 2024-10-16T14:39:19Z

bot: build repo:eessi.io-2023.06-software arch:x86_64/generic

eessi-bot · 2024-10-16T14:39:22Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:x86_64/generic from ocaisa
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/generic
handling command build repository:eessi.io-2023.06-software architecture:x86_64/generic resulted in:
- submitted job 23603, for details & status see Add accelerator detection to Lmod version of EESSI initialisation #781 (comment)

eessi-build-deploy-bot-deucalion · 2024-10-16T14:39:23Z

Updates by the bot instance boegel-bot-deucalion (click for details)

account ocaisa has NO permission to send commands to the bot

eessi-bot · 2024-10-16T14:39:23Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:x86_64/generic from ocaisa
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/generic
handling command build repository:eessi.io-2023.06-software architecture:x86_64/generic resulted in:
- no jobs were submitted

eessi-bot · 2024-10-16T14:39:27Z

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.10/pr_781/23603

date	job status	comment
Oct 16 14:39:26 UTC 2024	submitted	job id `23603` awaits release by job manager
Oct 16 14:39:32 UTC 2024	released	job awaits launch by Slurm scheduler
Oct 16 14:40:36 UTC 2024	running	job `23603` is running
Oct 16 14:46:46 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-23603.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-generic-1729089618.tar.gz` size: 0 MiB (2842 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/generic/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/generic/software no software packages in tarball other under 2023.06/software/linux/x86_64/generic `2023.06/init/modules/EESSI/2023.06.lua`
Oct 16 14:46:46 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ OK ] ( 1/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos /aeb2d9df @BotBuildTests:x86-64-generic-node+default P: perf: 278.829 timesteps/s (r:0, l:None, u:None) [ OK ] ( 2/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos /04ff9ece @BotBuildTests:x86-64-generic-node+default P: perf: 479.759 timesteps/s (r:0, l:None, u:None) [ OK ] ( 3/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /31ac6ab9 @BotBuildTests:x86-64-generic-node+default P: latency: 5.07 us (r:0, l:None, u:None) [ OK ] ( 4/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /f3be40a2 @BotBuildTests:x86-64-generic-node+default P: latency: 5.27 us (r:0, l:None, u:None) [ OK ] ( 5/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /10e66fba @BotBuildTests:x86-64-generic-node+default P: latency: 7.79 us (r:0, l:None, u:None) [ OK ] ( 6/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /5be57ae7 @BotBuildTests:x86-64-generic-node+default P: latency: 8.06 us (r:0, l:None, u:None) [ OK ] ( 7/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /c8c9aff5 @BotBuildTests:x86-64-generic-node+default P: latency: 0.7 us (r:0, l:None, u:None) [ OK ] ( 8/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /9795e491 @BotBuildTests:x86-64-generic-node+default P: latency: 0.88 us (r:0, l:None, u:None) [ OK ] ( 9/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /48da21c5 @BotBuildTests:x86-64-generic-node+default P: bandwidth: 11200.63 MB/s (r:0, l:None, u:None) [ OK ] (10/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /1b8c1ca2 @BotBuildTests:x86-64-generic-node+default P: bandwidth: 11228.71 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-23603.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
Oct 16 19:53:12 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-generic-1729089618.tar.gz` to S3 bucket succeeded

casparvl · 2024-10-16T14:42:57Z

I'm reluctant to put LMOD_PACKAGE_PATH into CI as it would need to be a sensible value if you are going to have it set when calling Lmod...and the only sensible one we have in CI is the one we ship with EESSI

Couldn't you copy (or symlink) that file to a new location, then point LMOD_PACKAGE_PATH there? I mean, it's no dealbreaker for me, I'm also fine without testing it - it is a bit tricky I admit since it affects stuff as well.

ocaisa · 2024-10-16T14:54:40Z

I'm not against it really but it feels like a potential CI rabbit hole since it does affect Lmod behaviour. If someone is keen enough, that could be done in a follow-up PR.

casparvl · 2024-10-16T19:50:01Z

Tried again. these were the only differences:

$ diff pre_env post_env
7c7
< _ModuleTable002_=fSwKc3RhY2tEZXB0aCA9IDAsCnN0YXR1cyA9ICJpbmFjdGl2ZSIsCnVzZXJOYW1lID0gIjIwMjMiLAp3ViA9ICJNLip6ZmluYWwiLAp9LApFYXN5QnVpbGQgPSB7CmZuID0gIi9zdy9ub2FyY2gvUkhFTDgvMjAyMi9tb2R1bGVmaWxlcy9hbGwvRWFzeUJ1aWxkLzQuOS4yLmx1YSIsCmZ1bGxOYW1lID0gIkVhc3lCdWlsZC80LjkuMiIsCmxvYWRPcmRlciA9IC0zLApwcm9wVCA9IHt9LApzdGFja0RlcHRoID0gMSwKc3RhdHVzID0gImluYWN0aXZlIiwKdXNlck5hbWUgPSAiRWFzeUJ1aWxkLzQuOS4yIiwKd1YgPSAiMDAwMDAwMDA0LjAwMDAwMDAwOS4wMDAwMDAwMDIuKnpmaW5hbCIsCn0sCmViID0gewpmbiA9ICIvc3cvbm9hcmNoL1JIRUw4LzIwMjIvbW9kdWxlZmlsZXMvYWxs
---
> _ModuleTable002_=U1Y5QlVrTklSRVZVUlVOVVgwOVFWRWxQVGxNaUxDSjRPRFpmTmpRdllXMWtMM3BsYmpNaUtRPT0iLAp9LApbIkwyTjJiV1p6TDNOdlpuUjNZWEpsTG1WbGMzTnBMbWx2TDNabGNuTnBiMjV6THpJd01qTXVNRFl2YVc1cGRDOXNiVzlrWDJWbGMzTnBYMkZ5WTJoa1pYUmxZM1JmZDNKaGNIQmxjbDloWTJObGJDNXphQT09Il0gPSB7CiJjMlYwWlc1MktDSkZSVk5UU1Y5QlEwTkZURjlUVlVKRVNWSWlMQ0poWTJObGJDOXVkbWxrYVdFdlkyTTRNQ0lwIiwKfSwKfSwKcHJvcFQgPSB7fSwKc3RhY2tEZXB0aCA9IDAsCnN0YXR1cyA9ICJhY3RpdmUiLAp1c2VyTmFtZSA9ICJFRVNTSS8yMDIzLjA2IiwKd1YgPSAiMDAwMDAyMDIzLjAwMDAwMDAwNi4qemZpbmFsIiwKfSwKfSwKbXBhdGhB
46a47
> __LMOD_STACK_LMOD_PACKAGE_PATH=L3N3L25vYXJjaC9MTW9kSG9va3M=

Not sure what exactly this _LMOD_STACK thing is, but I'm ok with it.

eessi-build-deploy-bot-deucalion · 2024-10-16T19:52:54Z

Label bot:deploy has been set by user casparvl, but this person does not have permission to trigger deployments

eessi-bot · 2024-10-17T10:48:55Z

PR merged! Moved ['/project/def-users/SHARED/jobs/2024.10/pr_781/23406', '/project/def-users/SHARED/jobs/2024.10/pr_781/23584', '/project/def-users/SHARED/jobs/2024.10/pr_781/23587', '/project/def-users/SHARED/jobs/2024.10/pr_781/23592', '/project/def-users/SHARED/jobs/2024.10/pr_781/23603'] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2024.10.17

eessi-build-deploy-bot-deucalion · 2024-10-17T10:48:55Z

PR merged! Moved [] to /home/kehoste/project_dir/bot/trash-bin #$HOME/trash_bin/EESSI/software-layer/2024.10.17

eessi-bot · 2024-10-17T10:48:56Z

PR merged! Moved [] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2024.10.17

Add accelerator detection to Lmod version of EESSI initialisation

887bc8a

ocaisa marked this pull request as ready for review October 11, 2024 15:44

ocaisa commented Oct 11, 2024

View reviewed changes

init/modules/EESSI/2023.06.lua Show resolved Hide resolved

Make a separate PR for the lmod wrapper

2c7553b

ocaisa mentioned this pull request Oct 15, 2024

Put a Lmod-relevant wrapper in place for archdetect accelerator detection #783

Merged

ocaisa added 13 commits October 15, 2024 11:01

Merge remote-tracking branch 'upstream/2023.06-software.eessi.io' int…

f4ee9d4

…o lmod_gpu

Add accelerator check to Lmod init script

cf5491b

Match all variables that start with EESSI_

e7eb879

Lmod init uses archdetect, but init script still uses archspec

1311055

init script is the only one who sets EESSI_ARCHDETECT EESSI_ARCHSPEC

d4d5a79

Use the correct override for when GPUs are expected

c7d4230

Add a load/unload test to make sure we return the environment to it's…

5fd01f8

… original state

Try to make module work in load and unload modes

7abcdc3

Fix lots of small issues

e4ac2fa

Fix lots of small issues

3829791

Fix lots of small issues

443cdef

Use debug feature for module a bit more

78293e6

Correct comment in action

fa10c1a

ocaisa added the ready-to-deploy Mark a PR as ready to deploy label Oct 15, 2024

ocaisa added 3 commits October 16, 2024 09:55

Add more debug logging

9c4897c

Add debug logging to CI

86e0c4f

Add LMOD_RC and LMOD_PACKAGE_PATH to our checks

87c6cdf

ocaisa removed the ready-to-deploy Mark a PR as ready to deploy label Oct 16, 2024

ocaisa added the ready-to-deploy Mark a PR as ready to deploy label Oct 16, 2024

casparvl reviewed Oct 16, 2024

View reviewed changes

Update 2023.06.lua

04c2573

boegel added pilot-2023.04 2023.06-software.eessi.io 2023.06 version of software.eessi.io labels Oct 16, 2024

casparvl approved these changes Oct 16, 2024

View reviewed changes

casparvl added bot:deploy Ask bot to deploy missing software installations to EESSI and removed ready-to-deploy Mark a PR as ready to deploy labels Oct 16, 2024

ocaisa removed the pilot-2023.04 label Oct 17, 2024

boegel approved these changes Oct 17, 2024

View reviewed changes

boegel merged commit 901a944 into EESSI:2023.06-software.eessi.io Oct 17, 2024
50 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add accelerator detection to Lmod version of EESSI initialisation #781

Add accelerator detection to Lmod version of EESSI initialisation #781

ocaisa commented Oct 11, 2024 •

edited

Loading

eessi-bot bot commented Oct 11, 2024

eessi-bot bot commented Oct 11, 2024

ocaisa commented Oct 15, 2024 •

edited

Loading

ocaisa commented Oct 15, 2024

eessi-bot bot commented Oct 15, 2024 •

edited

Loading

eessi-build-deploy-bot-deucalion bot commented Oct 15, 2024

eessi-bot bot commented Oct 15, 2024 •

edited

Loading

eessi-bot bot commented Oct 15, 2024 •

edited

Loading

eessi-build-deploy-bot-deucalion bot commented Oct 16, 2024

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

ocaisa commented Oct 16, 2024

casparvl left a comment •

edited

Loading

ocaisa commented Oct 16, 2024

ocaisa commented Oct 16, 2024

ocaisa commented Oct 16, 2024

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

eessi-build-deploy-bot-deucalion bot commented Oct 16, 2024

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

casparvl commented Oct 16, 2024 •

edited

Loading

ocaisa commented Oct 16, 2024

casparvl commented Oct 16, 2024

eessi-build-deploy-bot-deucalion bot commented Oct 16, 2024

eessi-bot bot commented Oct 17, 2024

eessi-build-deploy-bot-deucalion bot commented Oct 17, 2024

eessi-bot bot commented Oct 17, 2024

Add accelerator detection to Lmod version of EESSI initialisation #781

Add accelerator detection to Lmod version of EESSI initialisation #781

Conversation

ocaisa commented Oct 11, 2024 • edited Loading

eessi-bot bot commented Oct 11, 2024

eessi-bot bot commented Oct 11, 2024

ocaisa commented Oct 15, 2024 • edited Loading

ocaisa commented Oct 15, 2024

eessi-bot bot commented Oct 15, 2024 • edited Loading

eessi-build-deploy-bot-deucalion bot commented Oct 15, 2024

eessi-bot bot commented Oct 15, 2024 • edited Loading

eessi-bot bot commented Oct 15, 2024 • edited Loading

eessi-build-deploy-bot-deucalion bot commented Oct 16, 2024

eessi-bot bot commented Oct 16, 2024 • edited Loading

eessi-bot bot commented Oct 16, 2024 • edited Loading

ocaisa commented Oct 16, 2024

casparvl left a comment • edited Loading

Choose a reason for hiding this comment

ocaisa commented Oct 16, 2024

ocaisa commented Oct 16, 2024

ocaisa commented Oct 16, 2024

eessi-bot bot commented Oct 16, 2024 • edited Loading

eessi-build-deploy-bot-deucalion bot commented Oct 16, 2024

eessi-bot bot commented Oct 16, 2024 • edited Loading

eessi-bot bot commented Oct 16, 2024 • edited Loading

casparvl commented Oct 16, 2024 • edited Loading

ocaisa commented Oct 16, 2024

casparvl commented Oct 16, 2024

eessi-build-deploy-bot-deucalion bot commented Oct 16, 2024

eessi-bot bot commented Oct 17, 2024

eessi-build-deploy-bot-deucalion bot commented Oct 17, 2024

eessi-bot bot commented Oct 17, 2024

ocaisa commented Oct 11, 2024 •

edited

Loading

ocaisa commented Oct 15, 2024 •

edited

Loading

eessi-bot bot commented Oct 15, 2024 •

edited

Loading

eessi-bot bot commented Oct 15, 2024 •

edited

Loading

eessi-bot bot commented Oct 15, 2024 •

edited

Loading

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

casparvl left a comment •

edited

Loading

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

casparvl commented Oct 16, 2024 •

edited

Loading