Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] show less verbose log and give failed summary for each commit id #2319

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

AshburnLee
Copy link
Contributor

@AshburnLee AshburnLee commented Sep 24, 2024

Fix: #2302

Now we have a failed cases summary:
image
https://github.com/intel/intel-xpu-backend-for-triton/actions/runs/11009534190/job/30569394563

Note that there are no more detailed log for FAILED cases. so could not get exact error message for each cases.

@AshburnLee AshburnLee self-assigned this Sep 24, 2024
@AshburnLee AshburnLee changed the title show less verbose log [CI] show less verbose log and give failed summary for each commit id Sep 24, 2024
@pbchekin
Copy link
Contributor

The exact error message is not shown, there is only a list of failed tests.

2024-09-24T09:01:59.3474072Z cid: dc1221cd83e67efb94ec5c729f250bbe1d886707:
2024-09-24T09:01:59.3475958Z FAILED language/test_core.py::test_bitwise_op[1-int8-int8-|2]
2024-09-24T09:01:59.3477249Z FAILED language/test_core.py::test_bitwise_op[1-uint64-uint16-&3]
2024-09-24T09:01:59.3490394Z FAILED language/test_annotations.py::test_int_annotation[False-8]
...

@AshburnLee
Copy link
Contributor Author

AshburnLee commented Sep 26, 2024

The exact error message is not shown, there is only a list of failed tests.

2024-09-24T09:01:59.3474072Z cid: dc1221cd83e67efb94ec5c729f250bbe1d886707:
2024-09-24T09:01:59.3475958Z FAILED language/test_core.py::test_bitwise_op[1-int8-int8-|2]
2024-09-24T09:01:59.3477249Z FAILED language/test_core.py::test_bitwise_op[1-uint64-uint16-&3]
2024-09-24T09:01:59.3490394Z FAILED language/test_annotations.py::test_int_annotation[False-8]
...

In our case, there is no more detailed error message in the original log. But I still capture the raw log for each failed cases:

Tests failed for translator commit dc1221cd83e67efb94ec5c729f250bbe1d886707:
=================================== FAILURES ===================================
____________________ test/unit/language/test_annotations.py ____________________
[gw0] linux -- Python 3.10.14 /home/jovyan/conda/envs/junhui-py310/bin/python3
worker 'gw0' crashed while running 'test/unit/language/test_annotations.py::test_int_annotation[False-8]'
_______________________ test/unit/language/test_core.py ________________________
[gw6] linux -- Python 3.10.14 /home/jovyan/conda/envs/junhui-py310/bin/python3
worker 'gw6' crashed while running 'test/unit/language/test_core.py::test_bitwise_op[1-int32-uint64-^1]'
...
================== xdist: maximum crashed workers reached: 32 ==================
No warnings to write.
=========================== short test summary info ============================

Tests failed for translator commit 569972a61c86aa6892df443c6405283235022247:
=================================== FAILURES ===================================
_______________________ test/unit/language/test_core.py ________________________
[gw2] linux -- Python 3.10.14 /home/jovyan/conda/envs/junhui-py310/bin/python3
worker 'gw2' crashed while running 'test/unit/language/test_core.py::test_bin_op[1-uint32-bfloat16-/]'
_______________________ test/unit/language/test_core.py ________________________
[gw6] linux -- Python 3.10.14 /home/jovyan/conda/envs/junhui-py310/bin/python3
worker 'gw6' crashed while running 'test/unit/language/test_core.py::test_bitwise_op[1-int32-uint64-^1]'
____________________ test/unit/language/test_annotations.py ____________________
[gw0] linux -- Python 3.10.14 /home/jovyan/conda/envs/junhui-py310/bin/python3
worker 'gw0' crashed while running 'test/unit/language/test_annotations.py::test_int_annotation[False-8]'
...

spirv-llvm-translator.conf has been updated to the latest cid, so there is no test run yet.

@pbchekin
Copy link
Contributor

pbchekin commented Oct 5, 2024

In our case, there is no more detailed error message in the original log. But I still capture the raw log for each failed cases:

Right, this is what #2302 about, the error message is in the middle of a huge log.

Copy link
Contributor

@pbchekin pbchekin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The problem identified in #2302 still persists.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Logs for "Automate update Translator cid" are not readable
2 participants