Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lower scheduling priority of preprocessing #661

Open
pflanze opened this issue Dec 11, 2024 · 0 comments
Open

Lower scheduling priority of preprocessing #661

pflanze opened this issue Dec 11, 2024 · 0 comments

Comments

@pflanze
Copy link
Contributor

pflanze commented Dec 11, 2024

Preprocessing, while running, takes a lot of CPU, and leads to the api becoming unresponsive at times; make sure the kernel gives the api priority by de-prioritizing the preprocessing explicitly. This can be done by starting the preprocessing via the "nice" command, which add 10 points to the priority (making it less prioritized); best run it through "nice" twice, then it reaches the maximum value of 19. I.e. have the Docker container start "nice nice path/to/silo preprocessing ...".

This could also be doable by telling docker to start the whole image with a lower priority, but then that requires us to learn how to, and it will require all users to think of it; probably better to just get it done here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant