Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve pipeline speed and abort early #789

Open
ernestum opened this issue Sep 21, 2023 · 0 comments
Open

Improve pipeline speed and abort early #789

ernestum opened this issue Sep 21, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@ernestum
Copy link
Collaborator

ernestum commented Sep 21, 2023

Problem

In the last month we doubled our median pipeline runtime and we also spend a lot of CirlceCI credits on failed pipelines

Solution

  1. Make the pipeline faster
    • use ruff instead of flake8
    • stop using custom docker images (should load faster since default images are still in the cache of the runners)
    • weed out really slow tests (the new SQIL tests are slooow)
    • Use the parallel test runs feature of CircleCI
  2. Make the pipeline fail earlier so we spend less credits on failed pipelines
  3. Finally remove the windows pipeline (I assume it has the least amount of users and causes the highest amount of pipeline errors). I think windows users reporting issues when they come up for them might be enough.
  4. Only run tests that cover changed sections of the code

Possible alternative solutions

  • Find ways to change perception of time. Then waiting for the pipeline might become less annoying.
  • Stop caring for money spent on compute and waiting humans.
@ernestum ernestum added the enhancement New feature or request label Sep 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant