From b6f6132bf7d3918326095d243556a807a0f6b797 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Michael=20J=C3=A4hn?= Date: Tue, 17 Dec 2024 14:33:14 +0100 Subject: [PATCH] Update to current status, remove under construction --- docs/alps/uenvs.md | 9 +---- docs/alps/vclusters.md | 83 ++++++++++++++++++++++++------------------ 2 files changed, 49 insertions(+), 43 deletions(-) diff --git a/docs/alps/uenvs.md b/docs/alps/uenvs.md index b9106dd4..99f33320 100644 --- a/docs/alps/uenvs.md +++ b/docs/alps/uenvs.md @@ -1,10 +1,3 @@ -!!! construction "Page under construction - last update: 2024-09-06" - - Information in this page is not yet complete nor final. It will be updated following the progress of - - - the Alps system deployment at CSCS - - C2SM's adaptation to this new system - # User Environments Software stacks at CSCS are now accessible through the so-called User Environments (uenv). They replace the previous monolithic software stack containing everything from which one could load any module, with all the infinite potential conflicts it involves. User environments contain the minimal software stack required for a certain activity, say, building and running ICON. They are generated by `spack`, packed into single `squashfs` file and then mounted by the user. In a way, they can be considered as poor man's containers. @@ -29,7 +22,7 @@ The user environments provided by CSCS are registered in a central database. In !!! warning - Old software stack images didn't have a mount point in the metadata which is now required for the new versions of the `uenv` tool and its `--uenv` slurm plugin counterpart. If you have images in your local repository that are older than roughly September 5th, please pull them again. It will only update the metadata + Old software stack images didn't have a mount point in the metadata which is now required for the new versions of the `uenv` tool and its `--uenv` slurm plugin counterpart. If you have images in your local repository that are older than roughly September 5th, please pull them again - it will only update the metadata. ## The `uenv` command line tool diff --git a/docs/alps/vclusters.md b/docs/alps/vclusters.md index af1e9354..39ddfa17 100644 --- a/docs/alps/vclusters.md +++ b/docs/alps/vclusters.md @@ -1,10 +1,3 @@ -!!! construction "Page under construction - last update: 2024-12-17" - - Information in this page is not yet complete nor final. It will be updated following the progress of - - - the Alps system deployment at CSCS - - C2SM's adaptation to this new system - # Supported vClusters This page is hosting information about C2SM supported vClusters (not all CSCS vClusters). @@ -29,54 +22,74 @@ Host balfrin* daint* santis* todi* This would allow standard connections like `ssh santis` but also specifying the login node like `ssh santis-ln002` if needed. Replace `cscsusername` with your actual user name. -## Daint - -Daint (Alps) is the vCluster dedicated to the User Lab. It is currently accessible at `daint.alps.cscs.ch` (until the current Piz Daint gets decommissioned), so connect with `ssh daint.alps` with the `ssh` settings above. +## Santis -Even though Weather and Climate also has the dedicated vCluster Santis (see [below](#santis)), traditional projects might also land on Daint. +The vCluster `santis` is dedicated to **Climate and Weather**. It might, at the beginning, only host [EXCLAIM :material-open-in-new:](https://c2sm.ethz.ch/research/exclaim.html){:target="_blank"} and related projects. -### Uenvs +### Deployment Status -List of currently supported Uenvs on Daint: +By the end of 2024, the deployment is complete only to ~95 %. -| uenv | activity | Remark | -|--------------------------|--------------------------------|---------------------| -| icon-vx:rcy | build and run ICON | Not deployed (yet?) | -| netcdf-tools/2024:v1-rc1 | pre- and post-processing tools | | +### Differences to the Environment on `todi` -### Storage +- `$HOME` is now on a new NFS file system + - Your folder `/users/$USER` will be mostly empty + - The NFS system still requires some fine-tuning and file system performance might be low. + - We recommend to do (especially heavy tasks) on `$SCRATCH` +- The `$HOME` of `todi` is mounted in `/users.OLD/$USER` + - ⚠️ The mount is read-only! + - You are responsible to copy your data from `/users.OLD/$USER` :material-arrow-right-thin: `/users/$USER/...` + - The mount is temporary - will be removed towards end of January 2025. -!!! note "TODO" +!!! info - - [ ] Storage + Despite the need to work on the deployment in the upcoming days, users are invited to already access the system and start familiarising yourself with it and they might also start the data migration of your old home. -## Santis + The activities on CSCS side should not require any reboot, however, some services might need to be restarted, e.g., SLURM. This could lead to short interruptions or even failing jobs. CSCS will provide more information in the upcoming days and will try to minimise the risk of interferences by consolidating changes. -!!! warning "Santis has not been deployed yet." +### Uenvs -Santis is dedicated to Weather and Climate. It might, at the beginning, only host [EXCLAIM :material-open-in-new:](https://c2sm.ethz.ch/research/exclaim.html){:target="_blank"} and related projects. +To find and use already existing uenvs from `todi`, you need to modify the `CLUSTER_NAME` environment variable. -### Uenvs +```shell +export CLUSTER_NAME=todi +uenv image find +``` -| uenv | activity | -|--------------------------|--------------------------------| -| icon-vx:rcy | build and run ICON | -| netcdf-tools/tag:version | pre- and post-processing tools | +| uenv | activity | +|----------------------------|--------------------------------| +| `icon-wcp/v1:rc4` | build and run ICON | +| `netcdf-tools/2024:v1-rc1` | pre- and post-processing tools | ### Storage !!! note "TODO" - - [ ] Storage +The migration of the previous storage is not yet finished. Once there is an update from CSCS, we will inform you here. Also note that the environment variables `$STORE` and `$PROJECT` are not yet set. +## Daint -## Tödi +Daint (Alps) is the vCluster dedicated to the **User Lab**. It is currently accessible at `daint.alps.cscs.ch` (until the current Piz Daint gets decommissioned), so connect with `ssh daint.alps` with the `ssh` settings above. -Tödi is the testing vCluster and is currently deployed on the most of the Alps system. +Even though Climate and Weather also has the dedicated vCluster `santis` (see [below](#santis)), traditional projects might also land on Daint. ### Uenvs -| uenv | activity | -|--------------------------|--------------------------------| -| icon-wcp/v1:rc4 | build and run ICON | -| netcdf-tools/2024:v1-rc1 | pre- and post-processing tools | +Same as on `santis`, one can access the uenvs from `todi`: + +```shell +export CLUSTER_NAME=todi +uenv image find +``` + +| uenv | activity | +|----------------------------|--------------------------------| +| `icon-wcp/v1:rc4` | build and run ICON | +| `netcdf-tools/2024:v1-rc1` | pre- and post-processing tools | + +### Storage + +!!! note "TODO" + +The migration of the previous storage is not yet finished. Once there is an update from CSCS, we will inform you here. +