-
Notifications
You must be signed in to change notification settings - Fork 49
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Selective Workload Loading #149
Labels
Comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Working with a workload in a directory with lots of other workloads is much slower than it should be. This is because we're doing more build dependency checking than we really have to:
There were practical reasons for this:
The load times are the primary concern, but there are other issues as well. For example, bugs in unrelated workloads will cause a job to fail.
The solution is probably to rework the configuration loading scheme to manually trace the chain of 'base' arguments and only load workloads that actually matter. This will require a refactoring of the config loading system which might be fairly involved.
If we still want faster loads after that, we can work on deduping the dependency checking (probably by making each config_changed style criteria to its own task and performing the dedup at that point.
The text was updated successfully, but these errors were encountered: