Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate how many APIs can be tested in parallel by nimibot. #2017

Open
ni-jfitzger opened this issue Sep 18, 2023 · 1 comment
Open

Investigate how many APIs can be tested in parallel by nimibot. #2017

ni-jfitzger opened this issue Sep 18, 2023 · 1 comment

Comments

@ni-jfitzger
Copy link
Collaborator

Description of issue

There are 3 nimibot runners.

  • 1 for Linux
  • 1 for 32-bit Python on Windows
  • 1 for 64-bit Python on Windows

By default, if max-parallel is not specified in the workflow, a value will be used based upon runner availability. Since we seem to only test 3 APIs on each nimibot at once, I suspect this is being set to 3 based upon the existence of 3 runners, despite the fact that each workflow is restricted to a specific runner. We might be able to set it higher and test more APIs at once, reducing the time that it takes to complete testing.

(We should keep in mind that there are shared resources, like the grpc_device_server and some multi-threading tests). I also don't know how many processors these VMs have available. It may or may not be a good idea to set max-parallel all the way to 9.

@ni-jfitzger ni-jfitzger changed the title Investigate how many APIs can be tested in parallel, by nimibot. Investigate how many APIs can be tested in parallel by nimibot. Sep 18, 2023
@ni-jfitzger
Copy link
Collaborator Author

Since we seem to only test 3 APIs on each nimibot at once, I suspect this is being set to 3 based upon the existence of 3 runners, despite the fact that each workflow is restricted to a specific runner.

I don't think that's what's happening, after all. For a run on master, we had 5 APIs being tested at once.
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant