Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix JENKINS-56740 - AWS CLI Option for artifacts over 5Gb with S3 Storage Class select option (STANDARD, STANDARD_IA). #467

Open
wants to merge 6 commits into
base: master
Choose a base branch
from

Commits on Feb 27, 2024

  1. MRL-80449: Add option for AWS S3 upload via CLI (aws s3 cp)

    Option to use AWS CLI for big artifacts (over 5Gb) upload
    to AWS S3 with default Storage Class (STANDARD).
    
    CLI - Command Line Interface.
    Fix for JENKINS-56740 https://issues.jenkins.io/browse/JENKINS-56740
    
    Build note:
    
    1. Some tests fail, so may run with ignoring tests: -DskipTests
    
    2. build with Maven option -Dchangelist=plugin-version
    for example:
    
     mvn clean package -Dchangelist=master-tag.patch.version1.0
    
    or with cuirrent date, the lates tag and skipping tests:
    
     mvn clean package -DskipTests \
     -Dchangelist=$(git tag -l --sort=creatordate | tail -n 1).patch2.0.$(date +%Y%m%d-%H%M%S)
    
    Signed-off-by: tetiana.tvardovska <[email protected]>
    Change-Id: Ic0e35c2009afe88802bfb0a0476ede7311aec056
    tetiana.tvardovska committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    4913a84 View commit details
    Browse the repository at this point in the history
  2. MRL-80449: Update AWS S3 CLI to use storage-class STANDARD_IA

    STANDARD_IA S3 Storage Class was required for AWS cost-saving.
    
    Build command sample:
     mvn clean package -DskipTests \
      -Dchangelist=$(git tag -l --sort=creatordate | tail -n 1).patch2.1.$(git rev-list --count HEAD).$(date +%Y%m%d-%H%M%S)
    
    Signed-off-by: tetiana.tvardovska <[email protected]>
    Change-Id: Ia92e5731549d7161b6bdfa1a27f68a5acd72d70a
    tetiana.tvardovska committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    858bf4e View commit details
    Browse the repository at this point in the history
  3. MRL-80449: Add custom AWS S3 Storage Class option for AWS CLI mode

    1. Add option to select a custom AWS S3 Storage Class for uploaded objects:
    - STANDARD (default)
    - STANDARD_IA
    
    Note:
     a) SUPPORTED ONLY by AWS CLI mode.
     Selected custom Storage Class is supported by AWS CLI mode only!
    
     b) NOT SUPPORTED by AWS API mode.
     Default AWS API mode ignores any selected custom AWS S3 Storage Class -
     it will always upload filed with STANDARD Storage Class.
    
    2. Updated Readme with build and test notes.
    
    3.Add Maven property patch.version
    
    Notes:
    - Jenkins (2.443) or higher required
    - Build with skip test and Maven option -Dchangelist=plugin-version
    For example:
    
     mvn clean package -DskipTests \
     -Dchangelist=$(git tag -l --sort=creatordate | tail -n 1).patch2.2.$(git rev-list --count HEAD).$(date +%Y%m%d-%H%M%S)
    
    Or with patch.version:
    
     mvn clean package -DskipTests \
     -Dchangelist=$(git rev-parse --abbrev-ref HEAD)_v\${patch.version}-$( \
     git rev-list --count HEAD).$(git rev-parse --short HEAD)$(git diff --quiet || echo  .diff).$(date +%Y%m%d-%H%M%S
    
    Signed-off-by: tetiana.tvardovska <[email protected]>
    Change-Id: Ibeb1fbf74edba428ea0f0332f6cba12fdeb0a049
    tetiana.tvardovska committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    4253085 View commit details
    Browse the repository at this point in the history
  4. MRL-80449: Update Readme Changelog

    Add notes to Readme.md about new AWS options and other changes.
    
    Signed-off-by: tetiana.tvardovska <[email protected]>
    Change-Id: Ice71386e51411665cb68588c25f7b81f01fccd02
    tetiana.tvardovska committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    57775ad View commit details
    Browse the repository at this point in the history

Commits on Feb 29, 2024

  1. MRL-80449:467: Fix review issues - SpotBugs

    Fixes for failed ci.jenkins.io / SpotBugs checks
    https://github.com/jenkinsci/artifact-manager-s3-plugin/pull/467/checks?check_run_id=22052415895
    for Review Request jenkinsci#467
    jenkinsci#467
    
    Signed-off-by: tetiana.tvardovska <[email protected]>
    Change-Id: Ie446e4b334b71959905b82da92be0eda08465a85
    tetiana.tvardovska committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    7ac3072 View commit details
    Browse the repository at this point in the history
  2. MRL-80449:467: Update README.md AWS CLI and Storage Class options

    Changes for AWS CLI and Storage Class options:
    1. Update README.md - add description with images.
    2. Update README.md images related options:
    bucket-settings and custom-s3-service-configuration.
    3. Update config validation messages.
    4. Update Help texts.
    
    Signed-off-by: tetiana.tvardovska <[email protected]>
    Change-Id: I63cd59fa01425ad01b48f50cf5a2e6410449d603
    tetiana.tvardovska committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    58d499d View commit details
    Browse the repository at this point in the history