Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: enable multiprocessing on compile object level #27

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

MatteoVoges
Copy link
Member

Proposed Changes

  • new flag --multiprocess-objects
  • splits compile_obj from targets and run them in parallel, to balance out heavy targets

Performance Measurements

  • for inventories with targets with equally distributed target to compile_obj ratio --> 1:1
  • for inventories with unbalanced ratios: performance gain up to 400 %

Problems with tests

The tests are failing because of the removal target. The order of execution matters in this target. I think, we should change this example because compile objects should not depend on each other neither different targets should.

@MatteoVoges MatteoVoges added enhancement New feature or request kapicorp-PR open kapicorp PR labels Jan 11, 2024
@MatteoVoges MatteoVoges self-assigned this Jan 11, 2024
@MatteoVoges MatteoVoges force-pushed the feat/mp-target-objects branch from ecb7730 to 3025cf1 Compare January 11, 2024 13:46
@github-actions github-actions bot added the Stale label Mar 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request kapicorp-PR open kapicorp PR Stale
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant