Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(ci): update test runtimes #12203

Closed
wants to merge 49 commits into from
Closed

Conversation

team-gateway-bot
Copy link
Collaborator

This PR updates the test runtimes file to incorporate latest statistics for better scheduling.

It increases the repository size by 45.5KB.

The commit must be signed by a developer using these steps in the kong repository:

git fetch
git checkout -b chore/update-runtimes origin/update-runtimes
git commit --amend --no-edit --author "$(git config user.name) <$(git config user.email)>"
git push -f
git checkout main
git branch -d chore/update-runtimes

hanshuebner and others added 30 commits December 13, 2023 08:27
This commit adds an automatic scheduler for running busted tests.  It
replaces the static, shell script based scheduler by a mechanism that
distributes the load onto a number of runners.  Each runner gets to
work on a portion of the tests that need to be run.  The scheduler
uses historic run time information to distribute the work evenly
across runners, with the goal of making them all run for the same
amount of time.  With the 10 runners configured in the PR, the overall
time it takes to run tests is reduced from around 30 minutes to around
10 minutes.

Previously, the scheduling for tests was defined by what the
run_tests.sh shell script did.  This has now changed so that the new
JSON file `test_suites.json` is instead used to define the tests that
need to run.  Like before, each of the test suites can have its own
set of environment variables and test exclusions.

The test runner has been rewritten in Javascript in order to make it
easier to interface with the declarative configuration file and to
facilitate reporting and interfacing with busted.

A couple of tests had to be changed to isolate them from other tests
better.  As the tests are no longer run in identical order every time,
it has become more important that each test performs any required
cleanup before it runs.
@CLAassistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
1 out of 2 committers have signed the CLA.

✅ hanshuebner
❌ GitHub Actions Bot


GitHub Actions Bot seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

@team-gateway-bot team-gateway-bot deleted the chore/update-runtimes branch December 13, 2023 15:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants