Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce test skip and options to tolerate non-deterministic failure #195

Merged
merged 4 commits into from
Aug 20, 2024
Merged

Reduce test skip and options to tolerate non-deterministic failure #195

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
a1e4fbc
Remove test skip and option to tolerate non-deterministic failure
traversaro Aug 20, 2024
8139af1
Only run multiple times tests that are known to be flaky
traversaro Aug 20, 2024
fcd4b54
fixup
traversaro Aug 20, 2024
ad5b66d
Update apt.yml
traversaro Aug 20, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 9 additions & 4 deletions .github/workflows/apt.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -100,15 +100,20 @@ jobs:
if: contains(matrix.build_type, 'Release')
run: |
cd build
# So high until-pass as a mitigation for https://github.com/robotology/gz-sim-yarp-plugins/issues/75
ctest -E "^ImuTest" --repeat until-pass:20 --output-on-failure -C ${{ matrix.build_type }} .
# Deterministic tests
ctest -E "^ConcurrentInstancesTest|^ControlBoardOnMultipleGazeboInstancesTest|^CameraTest" --output-on-failure -C ${{ matrix.build_type }} .
# Non-deterministic tests
ctest -R "^ConcurrentInstancesTest|^ControlBoardOnMultipleGazeboInstancesTest|^CameraTest" --repeat until-pass:10 --output-on-failure -C ${{ matrix.build_type }} .

- name: Test (Debug)
if: contains(matrix.build_type, 'Debug')
run: |
cd build
# So high until-pass as a mitigation for https://github.com/robotology/gz-sim-yarp-plugins/issues/75
ctest -T Test -T Coverage --repeat until-pass:20 --output-on-failure -C ${{ matrix.build_type }} .
# Deterministic tests
ctest -E "^ConcurrentInstancesTest|^ControlBoardOnMultipleGazeboInstancesTest|^CameraTest" -T Test -T Coverage --output-on-failure -C ${{ matrix.build_type }} .
# Non-deterministic tests
ctest -R "^ConcurrentInstancesTest|^ControlBoardOnMultipleGazeboInstancesTest|^CameraTest" -T Test -T Coverage --repeat until-pass:10 --output-on-failure -C ${{ matrix.build_type }} .


- name: Install
run: |
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/conda-forge.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -89,15 +89,15 @@ jobs:
shell: bash -l {0}
run: |
cd build
ctest -E "^LaserTest|^CameraTest|^ImuTest" --repeat until-pass:5 --output-on-failure -C ${{ matrix.build_type }} .
# LaserTest and CameraTest are failing on conda-forge on Ubuntu: https://github.com/robotology/gz-sim-yarp-plugins/issues/196
ctest -E "^LaserTest|^CameraTest" --output-on-failure -C ${{ matrix.build_type }} .

- name: Test_macos
if: contains(matrix.os, 'macos')
shell: bash -l {0}
run: |
cd build
# ImuTest, ForceTorqueTest are skipped due to https://github.com/robotology/gz-sim-yarp-plugins/issues/54
ctest -E "^LaserTest|^CameraTest|^ImuTest|^ForceTorqueTest|^ControlBoardCommonsTest" --repeat until-pass:5 --output-on-failure -C ${{ matrix.build_type }} .
ctest --output-on-failure -C ${{ matrix.build_type }} .

- name: Install
run: |
Expand Down
Loading