Skip to content

Commit

Permalink
Added a test workflow (#309)
Browse files Browse the repository at this point in the history
Co-authored-by: Valentin Seitz <[email protected]>
Co-authored-by: Gerasimos Chourdakis <[email protected]>
  • Loading branch information
3 people authored Mar 13, 2024
1 parent a353484 commit ac79b78
Show file tree
Hide file tree
Showing 2 changed files with 39 additions and 0 deletions.
29 changes: 29 additions & 0 deletions .github/workflows/system-tests.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
name: System tests

on:
pull_request:
types: [labeled]

jobs:
gather-refs:
if: ${{ github.event.label.name == 'trigger-system-tests' }}
runs-on: ubuntu-latest
outputs:
reftutorials: ${{ steps.reftutorials.outputs.shorthash }}
steps:
- id: reftutorials
uses: nmbgeek/github-action-get-latest-commit@main
with:
owner: precice
repo: tutorials
branch: develop

run-system-tests:
if: ${{ github.event.label.name == 'trigger-system-tests' }}
needs: gather-refs
uses: precice/tutorials/.github/workflows/run_testsuite_workflow.yml@develop
with:
suites: openfoam_adapter_pr
build_args: TUTORIALS_REF:${{ needs.gather-refs.outputs.reftutorials }},PRECICE_REF:v3.0.0,OPENFOAM_EXECUTABLE:openfoam2306,OPENFOAM_ADAPTER_REF:${{ github.event.pull_request.head.sha }}
systests_branch: develop
loglevel: "DEBUG"
10 changes: 10 additions & 0 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,3 +27,13 @@ There are also a few additional workflows that can be triggered manually:
- `Check links`: checks the links in all markdown files to verify if they are still reachable.

Members of the repository can trigger these workflows in the "Actions" tab.

## System tests

For non-trivial pull requests, we also need to execute [system regression tests](https://precice.org/dev-docs-system-tests.html),
to ensure that complete simulations still run and give the same results.
Because these take long, run on an external system, and consume significant resources,
we are only triggering these on demand. Add (or ask a maintainer to add) the
`trigger-system-tests` label to the pull request to trigger them.
The tests will only run once, so that further commits don't consume additional
resources: In case you want to re-trigger them, remove and add the label again.

0 comments on commit ac79b78

Please sign in to comment.