[FEATURE] Automatic updating of deployed pipelines at node deployments

[tclose]

Links

Epic: [INSERT EPIC LINK HERE]
User Story Map: https://miro.com/app/board/uXjVOrM3BF4=/?moveToWidget=3458764531545892534&cot=14

Description

Once pipelines are designed and deployed to GHCR they need to be automatically pulled down to each of the AIS nodes in a way that is configurable by the node administrator.

Benefit Hypothesis

If deployed pipelines are pulled down to AIS nodes automatically, the users will be able to use the latest versions of pipelines without contacting the local node administrator.

Acceptance Criteria

• 1. New pipelines are pulled down to AIS nodes within the hour after they have been deployed
• 2. Pipelines are pulled by the node, not pushed by the pipeline deployment action

Stories

Release 1

• [STORY] Write script to update CS images on XNAT deployment #144
• [STORY] Notification of new pipeline images ready for use #145
• [STORY] Pipeline user access to latest AIS pipelines #160
• [STORY] Present changes in the new version of a pipeline  #161
• [STORY] Automate pipeline distribution to the users #162
• [STORY] Automatically update CS images on an AIS node #163
• [STORY] Use different version of images when running a pipeline #164

Release 2

• [STORY] Notify users when new version of a pipeline is available #165
• [STORY] Help pipeline users decide whether to use the updated pipeline or not #166
• [STORY] Notify pipeline users of any auto-updates #167
• [STORY] Publish bug-fixes #168
• [STORY] Publish improved methods #169

Release 3

Release 3 stories are placed on the user story map , but it is too early to create them in GitHub. Backlog should not be too big. Candidates as of 19/9/2022:

• As a user, I want to have a manageable list of pipelines to select from, so that I can find the appropriate one for my analysis
• As a Pipeline user, I would like to select a suitable pipeline for my analysis
• As AIS node admin, I would like to know what compute resource is required to run image xxx
• As AIS node admin, I would like to know when there is an updated image available
• As an AIS Node Admin, I want to understand computational requirements of a pipeline, so I know if my node can support it
• As an admin, I want to be able to select pipelines that are relevant to our node (i.e. only preclinical pipelines if there is only a preclinical scanner)
• As an AIS Node Admin, I want to know when pipelines are deprecated (e.g. 2+ year old, 4 versions old) so that they can be removed, or I can notify users

[github-actions]

Stories

• [STORY] Sort out issue with images not being cleaned up by deploy build #194
• [STORY] Sort out clean up of built docker images in package release #202
• [STORY] Automatically update CS images on an AIS node #163