Easyconfig that can extend EESSI #371

ocaisa · 2023-10-20T19:59:21Z

The idea would be to add this to (it's own?) easystack file, it will be found as it is in the same directory (as well the "sources" since they are just the hook). It currently requires write permissions to the host_injections directory as this allows us to automatically make the modules visible.

The name may be a bit suspect, as I would like to have EESSI as a module for different EESSI versions.

eessi-bot · 2023-10-20T19:59:25Z

Instance eessi-bot-mc-aws is configured to build:

arch x86_64/generic for repo eessi-hpc.org-2023.06-compat
arch x86_64/generic for repo eessi-hpc.org-2023.06-software
arch x86_64/intel/haswell for repo eessi-hpc.org-2023.06-compat
arch x86_64/intel/haswell for repo eessi-hpc.org-2023.06-software
arch x86_64/intel/skylake_avx512 for repo eessi-hpc.org-2023.06-compat
arch x86_64/intel/skylake_avx512 for repo eessi-hpc.org-2023.06-software
arch x86_64/amd/zen2 for repo eessi-hpc.org-2023.06-compat
arch x86_64/amd/zen2 for repo eessi-hpc.org-2023.06-software
arch x86_64/amd/zen3 for repo eessi-hpc.org-2023.06-compat
arch x86_64/amd/zen3 for repo eessi-hpc.org-2023.06-software
arch aarch64/generic for repo eessi-hpc.org-2023.06-compat
arch aarch64/generic for repo eessi-hpc.org-2023.06-software
arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-compat
arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-software
arch aarch64/neoverse_v1 for repo eessi-hpc.org-2023.06-compat
arch aarch64/neoverse_v1 for repo eessi-hpc.org-2023.06-software

EESSI-2023.06-extend.eb

boegel · 2023-10-24T09:49:24Z

Module name could be something like EESSI-eb-build-env/2023.06?

ocaisa · 2023-10-24T10:32:46Z

It's not very intuitive for the end user, I'm thinking EESSI-extend-2023.06-easybuild.eb

EESSI-extend-2023.06-easybuild.eb

ocaisa · 2023-11-07T13:00:05Z

Here are the differences between what the module gives and what the configure_easybuild script gives:

[ocaisa@smnode1 software-layer]$ diff source_env module_env 
4c4
< EASYBUILD_INSTALLPATH=/cvmfs/pilot.eessi-hpc.org/versions/2021.12/software/linux/x86_64/intel/skylake_avx512
---
> EASYBUILD_INSTALLPATH=/home/ocaisa/eessi/versions/2021.12/software/linux/x86_64/intel/skylake_avx512
8,9c8
< EASYBUILD_PREFIX=/easybuild
< EASYBUILD_SOURCEPATH=/easybuild/sources:
---
> EASYBUILD_PREFIX=/tmp/ocaisa/easybuild
11c10
< EASYBUILD_FILTER_DEPS=Autoconf,Automake,Autotools,binutils,bzip2,DBus,flex,gettext,gperf,help2man,intltool,libreadline,libtool,Lua,M4,makeinfo,ncurses,util-linux,XZ,zlib
---
> EASYBUILD_FILTER_DEPS=Autoconf,Automake,Autotools,binutils,bzip2,DBus,flex,gettext,gperf,help2man,intltool,libreadline,libtool,M4,makeinfo,ncurses,util-linux,XZ,zlib
13c12
< EASYBUILD_HOOKS=/home/ocaisa/software-layer/eb_hooks.py
---
> EASYBUILD_HOOKS=/project/def-sponsor00/easybuild/software/EESSI-extend/2023.06-easybuild/eb_hooks.py

Everything as expected here (I have already removed Lua as a filtered dep), the source path should be set by the bot

EESSI-extend-2023.06-easybuild.eb

akesandgren · 2024-02-12T13:32:59Z

I'd like to see this one move forward soon. Is there anything more it needs? I can start taking it into "production" locally right now to test things out unless that's already been done.

eessi-bot · 2024-02-12T13:33:03Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

account akesandgren has NO permission to send commands to the bot

ocaisa · 2024-02-12T15:45:50Z

I'd like to see this one move forward soon. Is there anything more it needs? I can start taking it into "production" locally right now to test things out unless that's already been done.

I've used it quite a bit myself, but someone else giving it a go could yield valuable feedback.

akesandgren · 2024-02-23T07:20:06Z

EESSI-extend-2023.06-easybuild.eb

+  easybuild_installpath = string.gsub(os.getenv("EESSI_SOFTWARE_PATH"), 'versions', 'host_injections')
+else
+  -- Would have liked to use os.getenv("EESSI_CVMFS_REPO") here but the hypen needs to be escaped
+  easybuild_installpath = string.gsub(os.getenv("EESSI_SOFTWARE_PATH"), "/cvmfs/pilot.eessi%-hpc.org", pathJoin(os.getenv("HOME"), "eessi"))


I see a future where this could benefit from the same thing we do for EasyBuild, i.e. going through a list of env vars to use as the base, i.e. HOME, PROJECT, etc. I.e. the envvars-user-modules config option

The benefit of the current setup is that we can configure EESSI to automatically expose the modules. Thinking about it though, it may be more interesting to do this in a more dynamic way inside the module itself...but the downside of this is you would have to always load the module to see the installed modules.

akesandgren · 2024-02-23T08:07:27Z

There is a potential problem here, we have an easybuild.cfg setup with various settings, among them we use HMNS. There may be a need to be more careful in overriding more things in this module...

eessi-bot · 2024-02-23T08:07:30Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

account akesandgren has NO permission to send commands to the bot

akesandgren · 2024-02-23T09:56:37Z

Anyway, initial testing of this is successful. EESSI extended in my $HOME with Wannier90 :-)
Now on to setting things up for our site extension, which is going to be somewhat more complicated

eessi-bot · 2024-02-23T09:56:40Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

account akesandgren has NO permission to send commands to the bot

ocaisa · 2024-02-23T09:59:57Z

@akesandgren Don't you want to wait until the dust settles on this? I can update the PR today to target the production branch. I also need to figure out what to do about the hook, it is a moving target so can't really be part of the installation

akesandgren · 2024-02-23T10:28:42Z

Nah, I'm just playing around and figuring out how to use this.
I need to start creating an environment where we can do SITE extension into our own cvmfs tree and also something that users can use (and eventually projects)
And then start looking at HMNS if at all possible...

eessi-bot · 2024-02-23T10:28:45Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

account akesandgren has NO permission to send commands to the bot

eessi-bot · 2024-05-07T17:34:32Z

New job on instance eessi-bot-mc-aws for architecture x86_64-intel-skylake_avx512 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_371/10318

date	job status	comment
May 07 17:34:31 UTC 2024	submitted	job id `10318` awaits release by job manager
May 07 17:35:06 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 17:45:03 UTC 2024	running	job `10318` is running
May 07 17:47:36 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-10318.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts No artefacts were created or found.
May 07 17:47:36 UTC 2024	test result	🤷 UNKNOWN (click triangle for detailed information) Job test file `_bot_job10318.test` does not exist in job directory or reading it failed.

eessi-bot · 2024-05-07T17:34:36Z

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen2 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_371/10319

date	job status	comment
May 07 17:34:35 UTC 2024	submitted	job id `10319` awaits release by job manager
May 07 17:34:53 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 17:42:29 UTC 2024	running	job `10319` is running
May 07 17:47:29 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-10319.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts No artefacts were created or found.
May 07 17:47:29 UTC 2024	test result	🤷 UNKNOWN (click triangle for detailed information) Job test file `_bot_job10319.test` does not exist in job directory or reading it failed.

eessi-bot · 2024-05-07T17:34:40Z

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_371/10320

date	job status	comment
May 07 17:34:39 UTC 2024	submitted	job id `10320` awaits release by job manager
May 07 17:34:56 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 17:42:32 UTC 2024	running	job `10320` is running
May 07 17:47:31 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-10320.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts No artefacts were created or found.
May 07 17:47:31 UTC 2024	test result	🤷 UNKNOWN (click triangle for detailed information) Job test file `_bot_job10320.test` does not exist in job directory or reading it failed.

eessi-bot · 2024-05-07T17:34:45Z

New job on instance eessi-bot-mc-aws for architecture aarch64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_371/10321

date	job status	comment
May 07 17:34:44 UTC 2024	submitted	job id `10321` awaits release by job manager
May 07 17:34:50 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 17:41:22 UTC 2024	running	job `10321` is running
May 07 17:47:24 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-10321.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts No artefacts were created or found.
May 07 17:47:24 UTC 2024	test result	🤷 UNKNOWN (click triangle for detailed information) Job test file `_bot_job10321.test` does not exist in job directory or reading it failed.

eessi-bot · 2024-05-07T17:34:48Z

New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_n1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_371/10322

date	job status	comment
May 07 17:34:48 UTC 2024	submitted	job id `10322` awaits release by job manager
May 07 17:36:10 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 17:46:09 UTC 2024	running	job `10322` is running
May 07 17:47:26 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-10322.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts No artefacts were created or found.
May 07 17:47:26 UTC 2024	test result	🤷 UNKNOWN (click triangle for detailed information) Job test file `_bot_job10322.test` does not exist in job directory or reading it failed.

eessi-bot · 2024-05-07T17:34:52Z

New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_v1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_371/10323

date	job status	comment
May 07 17:34:51 UTC 2024	submitted	job id `10323` awaits release by job manager
May 07 17:36:13 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 17:46:12 UTC 2024	running	job `10323` is running
May 07 17:47:28 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-10323.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts No artefacts were created or found.
May 07 17:47:28 UTC 2024	test result	🤷 UNKNOWN (click triangle for detailed information) Job test file `_bot_job10323.test` does not exist in job directory or reading it failed.

trz42 · 2024-05-07T17:47:22Z

bot: build repo:eessi.io-2023.06-software arch:x86_64/generic
bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell
bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512
bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2
bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3
bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen4
bot: build repo:eessi.io-2023.06-software arch:aarch64/generic
bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1
bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1

eessi-bot · 2024-05-07T17:47:24Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:x86_64/generic from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/generic
received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell
received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512
received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2
received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3
received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
received bot command build repo:eessi.io-2023.06-software arch:aarch64/generic from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/generic
received bot command build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1
received bot command build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1
handling command build repository:eessi.io-2023.06-software architecture:x86_64/generic resulted in:
- submitted job 10324, for details & status see Easyconfig that can extend EESSI #371 (comment)
handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell resulted in:
- submitted job 10325, for details & status see Easyconfig that can extend EESSI #371 (comment)
handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512 resulted in:
- submitted job 10326, for details & status see Easyconfig that can extend EESSI #371 (comment)
handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2 resulted in:
- submitted job 10327, for details & status see Easyconfig that can extend EESSI #371 (comment)
handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3 resulted in:
- submitted job 10328, for details & status see Easyconfig that can extend EESSI #371 (comment)
handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:aarch64/generic resulted in:
- submitted job 10329, for details & status see Easyconfig that can extend EESSI #371 (comment)
handling command build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1 resulted in:
- submitted job 10330, for details & status see Easyconfig that can extend EESSI #371 (comment)
handling command build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1 resulted in:
- submitted job 10331, for details & status see Easyconfig that can extend EESSI #371 (comment)

eessi-bot · 2024-05-07T17:47:25Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:x86_64/generic from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/generic
received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell
received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512
received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2
received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3
received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
received bot command build repo:eessi.io-2023.06-software arch:aarch64/generic from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/generic
received bot command build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1
received bot command build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1
handling command build repository:eessi.io-2023.06-software architecture:x86_64/generic resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512 resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2 resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3 resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:
- submitted job 77, for details & status see Easyconfig that can extend EESSI #371 (comment)
handling command build repository:eessi.io-2023.06-software architecture:aarch64/generic resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1 resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1 resulted in:
- no jobs were submitted

eessi-bot · 2024-05-07T17:47:29Z

New job on instance eessi-bot-mc-aws for architecture x86_64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_371/10324

date	job status	comment
May 07 17:47:28 UTC 2024	submitted	job id `10324` awaits release by job manager
May 07 17:48:57 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 17:50:27 UTC 2024	running	job `10324` is running
May 07 18:09:19 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10324.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-generic-1715104207.tar.gz` size: 0 MiB (758 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/generic/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/generic/software no software packages in tarball other under 2023.06/software/linux/x86_64/generic `2023.06/init/bash`
May 07 18:09:19 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10324.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 18:22:43 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-generic-1715104207.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T17:47:32Z

New job on instance eessi-bot-mc-aws for architecture x86_64-intel-haswell for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_371/10325

date	job status	comment
May 07 17:47:32 UTC 2024	submitted	job id `10325` awaits release by job manager
May 07 17:49:01 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 17:50:30 UTC 2024	running	job `10325` is running
May 07 18:08:15 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10325.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-intel-haswell-1715104210.tar.gz` size: 0 MiB (757 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/intel/haswell/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/intel/haswell/software no software packages in tarball other under 2023.06/software/linux/x86_64/intel/haswell `2023.06/init/bash`
May 07 18:08:15 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10325.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 18:23:02 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-haswell-1715104210.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T17:47:33Z

New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_371/77

date	job status	comment
May 07 17:47:32 UTC 2024	submitted	job id `77` awaits release by job manager
May 07 17:47:49 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 17:48:50 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-77.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen4-1715104107.tar.gz` size: 0 MiB (758 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/amd/zen4/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/amd/zen4/software no software packages in tarball other under 2023.06/software/linux/x86_64/amd/zen4 `2023.06/init/bash`
May 07 17:48:50 UTC 2024	test result	😢 FAILURE (click triangle for details) Reason EESSI test suite was not run, test step itself failed to execute. Details ✅ job output file `slurm-77.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 18:22:41 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-amd-zen4-1715104107.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T17:47:37Z

New job on instance eessi-bot-mc-aws for architecture x86_64-intel-skylake_avx512 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_371/10326

date	job status	comment
May 07 17:47:36 UTC 2024	submitted	job id `10326` awaits release by job manager
May 07 17:49:04 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 17:50:33 UTC 2024	running	job `10326` is running
May 07 18:07:09 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10326.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1715104207.tar.gz` size: 0 MiB (757 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software no software packages in tarball other under 2023.06/software/linux/x86_64/intel/skylake_avx512 `2023.06/init/bash`
May 07 18:07:09 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10326.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 18:23:21 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1715104207.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T17:47:40Z

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen2 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_371/10327

date	job status	comment
May 07 17:47:40 UTC 2024	submitted	job id `10327` awaits release by job manager
May 07 17:48:50 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 17:50:19 UTC 2024	running	job `10327` is running
May 07 18:11:24 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10327.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-1715104174.tar.gz` size: 0 MiB (757 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/amd/zen2/software no software packages in tarball other under 2023.06/software/linux/x86_64/amd/zen2 `2023.06/init/bash`
May 07 18:11:24 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10327.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 18:23:41 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-amd-zen2-1715104174.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T17:47:44Z

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_371/10328

date	job status	comment
May 07 17:47:44 UTC 2024	submitted	job id `10328` awaits release by job manager
May 07 17:48:54 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 17:50:23 UTC 2024	running	job `10328` is running
May 07 18:04:48 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10328.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen3-1715104169.tar.gz` size: 0 MiB (757 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/amd/zen3/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/amd/zen3/software no software packages in tarball other under 2023.06/software/linux/x86_64/amd/zen3 `2023.06/init/bash`
May 07 18:04:48 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10328.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 18:22:23 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-amd-zen3-1715104169.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T17:47:49Z

New job on instance eessi-bot-mc-aws for architecture aarch64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_371/10329

date	job status	comment
May 07 17:47:48 UTC 2024	submitted	job id `10329` awaits release by job manager
May 07 17:48:40 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 17:50:08 UTC 2024	running	job `10329` is running
May 07 18:03:35 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10329.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-generic-1715104195.tar.gz` size: 0 MiB (759 bytes) entries: 1 modules under 2023.06/software/linux/aarch64/generic/modules/all no module files in tarball software under 2023.06/software/linux/aarch64/generic/software no software packages in tarball other under 2023.06/software/linux/aarch64/generic `2023.06/init/bash`
May 07 18:03:35 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10329.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 18:24:00 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-generic-1715104195.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T17:47:53Z

New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_n1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_371/10330

date	job status	comment
May 07 17:47:52 UTC 2024	submitted	job id `10330` awaits release by job manager
May 07 17:48:43 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 17:50:12 UTC 2024	running	job `10330` is running
May 07 18:03:37 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10330.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-neoverse_n1-1715104202.tar.gz` size: 0 MiB (757 bytes) entries: 1 modules under 2023.06/software/linux/aarch64/neoverse_n1/modules/all no module files in tarball software under 2023.06/software/linux/aarch64/neoverse_n1/software no software packages in tarball other under 2023.06/software/linux/aarch64/neoverse_n1 `2023.06/init/bash`
May 07 18:03:37 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10330.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 18:24:20 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-neoverse_n1-1715104202.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T17:47:57Z

New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_v1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_371/10331

date	job status	comment
May 07 17:47:56 UTC 2024	submitted	job id `10331` awaits release by job manager
May 07 17:48:47 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 17:50:16 UTC 2024	running	job `10331` is running
May 07 17:59:45 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10331.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-neoverse_v1-1715104180.tar.gz` size: 0 MiB (757 bytes) entries: 1 modules under 2023.06/software/linux/aarch64/neoverse_v1/modules/all no module files in tarball software under 2023.06/software/linux/aarch64/neoverse_v1/software no software packages in tarball other under 2023.06/software/linux/aarch64/neoverse_v1 `2023.06/init/bash`
May 07 17:59:45 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10331.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 18:24:39 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-neoverse_v1-1715104180.tar.gz` to S3 bucket succeeded

all done and ingested now

trz42

Finally! Yeah! Yippieeeeeee 🥳

…1-foss-2022b {2023.06}[foss/2022b] bokeh V3.2.1

Easyconfig that can extend EESSI

9166400

Add extension of EESSI to MODULEPATH

f1a0e71

ocaisa commented Oct 20, 2023

View reviewed changes

EESSI-2023.06-extend.eb Outdated Show resolved Hide resolved

boegel requested changes Oct 24, 2023

View reviewed changes

EESSI-2023.06-extend.eb Outdated Show resolved Hide resolved

EESSI-2023.06-extend.eb Outdated Show resolved Hide resolved

ocaisa added 2 commits November 7, 2023 13:14

Allow for both site and user extensions to EESSI

98f20cd

Update EESSI-extend-2023.06-easybuild.eb

60cb5dc

ocaisa commented Nov 7, 2023

View reviewed changes

EESSI-extend-2023.06-easybuild.eb Outdated Show resolved Hide resolved

Escape hyphen for gsub

8fe3892

This was referenced Nov 8, 2023

Extending EESSI with different approaches #379

Open

document contribution policy for adding software to EESSI EESSI/docs#108

Merged

boegel changed the base branch from 2023.06 to pilot.eessi-hpc.org-2023.06 November 21, 2023 21:20

akesandgren reviewed Feb 12, 2024

View reviewed changes

EESSI-extend-2023.06-easybuild.eb Outdated Show resolved Hide resolved

akesandgren reviewed Feb 12, 2024

View reviewed changes

EESSI-extend-2023.06-easybuild.eb Outdated Show resolved Hide resolved

akesandgren reviewed Feb 23, 2024

View reviewed changes

ocaisa mentioned this pull request Apr 3, 2024

Add possibility to ignore certain hooks on local modules #530

Merged

ocaisa changed the base branch from 2023.06-pilot.eessi-hpc.org to 2023.06-software.eessi.io April 18, 2024 21:47

relax check or tarball is not created unless also software was built

999cbd3

trz42 added bot:deploy Ask bot to deploy missing software installations to EESSI and removed bot:deploy Ask bot to deploy missing software installations to EESSI labels May 7, 2024

boegel mentioned this pull request May 7, 2024

stick to x86_64/amd/zen3 when AMD Genoa (Zen4) is detected, until optimized software installations are available for Zen4 #569

Merged

trz42 approved these changes May 7, 2024

View reviewed changes

trz42 merged commit 241bf13 into EESSI:2023.06-software.eessi.io May 7, 2024
32 of 35 checks passed

ocaisa deleted the eessi_extend_module branch May 7, 2024 20:30

boegel mentioned this pull request May 7, 2024

{2023.06,zen4} foss/2023a #565

Merged

trz42 mentioned this pull request May 20, 2024

Rebuild EESSI-extend module to correctly handle EESSI_SITE_INSTALL #582

Closed

TopRichard added a commit to TopRichard/bot-software-layer1 that referenced this pull request May 24, 2024

Merge pull request EESSI#371 from TopRichard/nessi-2023.06-bokeh-3.2.…

9d4e433

…1-foss-2022b {2023.06}[foss/2022b] bokeh V3.2.1

Easyconfig that can extend EESSI #371

Easyconfig that can extend EESSI #371

Conversation

ocaisa commented Oct 20, 2023 • edited Loading

eessi-bot bot commented Oct 20, 2023

boegel commented Oct 24, 2023

ocaisa commented Oct 24, 2023

ocaisa commented Nov 7, 2023 • edited Loading

akesandgren commented Feb 12, 2024

eessi-bot bot commented Feb 12, 2024

ocaisa commented Feb 12, 2024

akesandgren Feb 23, 2024 • edited Loading

Choose a reason for hiding this comment

ocaisa Apr 19, 2024

Choose a reason for hiding this comment

akesandgren commented Feb 23, 2024

eessi-bot bot commented Feb 23, 2024

akesandgren commented Feb 23, 2024

eessi-bot bot commented Feb 23, 2024

ocaisa commented Feb 23, 2024

akesandgren commented Feb 23, 2024

eessi-bot bot commented Feb 23, 2024

eessi-bot bot commented May 7, 2024 • edited Loading

eessi-bot bot commented May 7, 2024 • edited Loading

eessi-bot bot commented May 7, 2024 • edited Loading

eessi-bot bot commented May 7, 2024 • edited Loading

eessi-bot bot commented May 7, 2024 • edited Loading

eessi-bot bot commented May 7, 2024 • edited Loading

trz42 commented May 7, 2024

eessi-bot bot commented May 7, 2024 • edited Loading

eessi-bot bot commented May 7, 2024 • edited Loading

eessi-bot bot commented May 7, 2024 • edited Loading

eessi-bot bot commented May 7, 2024 • edited Loading

eessi-bot bot commented May 7, 2024 • edited Loading

eessi-bot bot commented May 7, 2024 • edited Loading

eessi-bot bot commented May 7, 2024 • edited Loading

eessi-bot bot commented May 7, 2024 • edited Loading

eessi-bot bot commented May 7, 2024 • edited Loading

eessi-bot bot commented May 7, 2024 • edited Loading

eessi-bot bot commented May 7, 2024 • edited Loading

trz42 left a comment

Choose a reason for hiding this comment

ocaisa commented Oct 20, 2023 •

edited

Loading

ocaisa commented Nov 7, 2023 •

edited

Loading

akesandgren Feb 23, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading

eessi-bot bot commented May 7, 2024 •

edited

Loading