How to find out about changes in hpc-stack? #374
Replies: 7 comments 7 replies
-
|
All changes are done though GitHub, so a first line of defense would be to "Watch" the hpc-stack project, so you will receive notifications of all important events. But, I don't know if that would have worked in this case. I didn't see any mention of this... |
Beta Was this translation helpful? Give feedback.
-
|
I don't know how deletion of a library would be noted when watching the hpc-stack repo, nor how that would notify us if a installation of hpc-stack is available for use on a certain platform (although I'm assuming we'd see version number updates it github commits to know it's a possibility). I think this is important information and knowing where/how to look for it will be helpful to anyone using hpc-stack. Perhaps there are mailing lists that could be used for these types of announcements? Or a github wiki page to look at? Something else? |
Beta Was this translation helpful? Give feedback.
-
|
I saw that @Hang-Lei-NOAA posted information on https://github.com/ufs-community/ufs-weather-model/wiki/News a month ago (in a GitHub comment/on slack). I follow the ufs-weather-model fairly closely and admit I missed this announcement and seem to not be alone in missing this. Is this the place to now look for any future updates? Will information about modules that are not used in ufs-weather-model be posted there? |
Beta Was this translation helpful? Give feedback.
-
|
Also, Ed, could we add on the hpc-stack installation rule: Once the official release version is installed, the previous snapshot versions will be removed. This is rule has been discussed and agreed by Arun. |
Beta Was this translation helpful? Give feedback.
-
|
We make announcement in UFS is to hope every user could see. The ESMF snapshots is requested and used by UFS users. We could also add news in hpc-stack wiki. |
Beta Was this translation helpful? Give feedback.
-
|
@Hang-Lei-NOAA it seems like other repos like the global-workflow, ufs-utils, gldas also use ESMF and missed the announcement. |
Beta Was this translation helpful? Give feedback.
-
|
We only found that UFS has NEWS announcement page. Others do not have. In addition, these are either UFS dependencies or submodules. Since all these snapshots are requested by UFS code managers, we discussed with Jun, and make the annouement on the only NEWS page we have then. I just created a NEWS page for hpc-stack. We will also put announcement there from now on. |
Beta Was this translation helpful? Give feedback.
-
|
Watching a repo is way too noisy for non-stack developers, and may not pick up installation changes anyway. hpc-stack should have an announce list like others like global-workflow has. And warning needs to be given, especially before a removal, so users can prepare. This also points to a code management issue. If I point to a specific release installation of hpc-stack, I expect it to not change. But it's happened several times that modules were reinstalled or otherwise changed without a new hpc-stack version number. |
Beta Was this translation helpful? Give feedback.
-
|
In terms of the hpc-stack version number, this is a known problem with hpc-stack. As we migrate to spack in the year ahead, this problem will go away. Spack does a much better job of keeping track of exactly what versions were used... |
Beta Was this translation helpful? Give feedback.
-
|
Changes on Hera are no ways to avoid. UFS ask to install new libs, but no space available. ESMF and snapshots takes more than 70% space. We also want to keep installations without more changes. But to maintain the hera installations, we have been struggling with limited space for a year around. Since ESMF is too large, and our space is not unlimited, removing ESMF old and snapshot installations would be a new regular status in future. In addition, Installations of new compiler versions on Hera would start from a new disk. |
Beta Was this translation helpful? Give feedback.
-
|
Back to the communications issue: I think there should be an hpc-stack announcement list. It should be a new one with just the other repo code managers on it because they are the ones that are responsible for making any needed changes and announcing it to their own developers when their own repo gets updated to a new package. |
Beta Was this translation helpful? Give feedback.
-
|
Agreed. As Jessica suggested, I just created a NEWS page on hpc-stack wiki to announce the upcoming changes in both installation or repos. |
Beta Was this translation helpful? Give feedback.
-
|
@Hang-Lei-NOAA --- a news page is helpful, but might not be sufficient (as I think many missed the news wiki update on the ufs-weather-model). I'd second @WalterKolczynski-NOAA suggestion in having an announcement list or some additional method of communication for these important updates. |
Beta Was this translation helpful? Give feedback.
-
|
Yes, will discuss with others and see how this announcement list could act. |
Beta Was this translation helpful? Give feedback.
-
A recent issue occurred (see hpc-slack channel) or global-workflow issue: NOAA-EMC/global-workflow#561 where a library was removed due to space which resulted in issues. Where should hpc-stack users be looking to find out about installations of modules being removed or alternatively that new modules are available and we should be moving to use those?
Beta Was this translation helpful? Give feedback.
All reactions