Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve Docker Image extraction speed for linux ec2 instances #374

Closed
chawinphat opened this issue Dec 3, 2023 · 2 comments · Fixed by #471
Closed

Improve Docker Image extraction speed for linux ec2 instances #374

chawinphat opened this issue Dec 3, 2023 · 2 comments · Fixed by #471
Assignees
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@chawinphat
Copy link

chawinphat commented Dec 3, 2023

Is your feature request related to a problem? Please describe

Docker image extraction can be sped by extracting files in parallel. While Linux extraction time is fast already, parallelizing this process will be a good quality of life change.

Describe the solution you'd like

We can use Pigz instead of Gzip within the al2023 agent's [scripts].(https://github.com/opensearch-project/opensearch-ci/blob/main/packer/scripts/al2023/al2023-agent-setups.sh)

@peterzhuamazon has already done this implementation for the Windows agent instance in this code block.

Describe alternatives you've considered

No response

Additional context

No response

@chawinphat chawinphat added enhancement New feature or request untriaged Issues that have not yet been triaged labels Dec 3, 2023
@jordarlu jordarlu added good first issue Good for newcomers and removed untriaged Issues that have not yet been triaged labels Dec 5, 2023
@jordarlu
Copy link
Contributor

jordarlu commented Dec 5, 2023

Thanks for opening this issue and PR, the community willl review it and comment ... thanks again !!

@peterzhuamazon
Copy link
Member

I will add more changes of pigz soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment