Upgrade of 2A

[DinaBelova]

Goals

• Provide a efficient, user friendly way to upgrade the 2A system and its related components handling the dependencies without impacting the deployed managed clusters.
• This update is independent of the templates update and lifecycle management described in Template Lifecycle Management (goals, desired UX specification, etc.) #296 and ServiceTemplate Lifecycle Management (goals, desired UX specification, etc.) #248 but is related in that the dependency mapping of templates to 2a will need to be provided for.

Major deliverables

• A simple 2A upgrade system which follows k8s best practices and allows a platform lead to update the 2A systems and manage any dependencies
• Automated backup of the 2A and related configuration objects

Who it benefits

• Customer Business: Stable management solution that continuously receive upgrades that ensure uptime and security
• Platform Engineering Teams: Stress free upgrades without a massive amount of work to upgrade

Acceptance criteria

• 2A can be upgraded through a simple update command, that will ensure all the components are upgrade
• Validation of dependencies and update of related components
  • check if any of the Templates have a dependency on a Major Version of a 2A/CAPx component
• The ability to gracefully handle the failure to update a component
  • Provide meaningful information on the failure cause
  • Ability for Platform Lead to fix the fault manually (assumption its something easy fixable like a mgmt custer compute node ran out of memory) and tell 2A to continue the update (no automated rollback)
  • Platform Engineer has the possibility to rollback 2A and objects (see AC above) in a manual process
  • No outage impact the running Managed Cluster

Assumptions / out of scope

• Backup / restore capabilities will be handled as a part of separate discussion / epic. Link - tbd.

Telemetry & Success Criteria

• Cluster update attempts and status are sent to telemetry with the time and date - The goal is to understand cluster update status