Skip to content

Nightly fast dispatch tests #5775

Nightly fast dispatch tests

Nightly fast dispatch tests #5775

Triggered via schedule November 14, 2024 16:00
Status Failure
Total duration 2h 13m 53s
Artifacts 23
build-artifact  /  ...  /  build-docker-image
19s
build-artifact / build-docker-image / build-docker-image
Matrix: build-artifact / build-artifact
Matrix: fd-nightly / fd-nightly
Matrix: fd-nightly / nightly-wh-models
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 2 warnings, and 137 notices
fd-nightly / Nightly N150 mistral7b_eth
Process completed with exit code 1.
fd-nightly / Nightly N150 mamba
Process completed with exit code 1.
fd-nightly / Nightly N150 common_models
Process completed with exit code 1.
fd-nightly / FD [Unstable] N150 models wormhole_b0
The self-hosted runner: tt-metal-ci-vm-28 lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.
fd-nightly / FD Common models GS grayskull
Process completed with exit code 1.
fd-nightly / FD WH N300 ttnn nightly wormhole_b0
Process completed with exit code 1.
fd-nightly / FD GS ttnn nightly grayskull
Process completed with exit code 1.
fd-nightly / Nightly N300 mamba
The action 'Run frequent reg tests scripts' has timed out after 50 minutes.
pcie-cards-are-being-used-cleanup
Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully. This can happen if a test hung and is normally an issue with the test, rather than infra.
fd-nightly / Nightly N300 mamba
Process completed with exit code 1.
fd-nightly / FD WH N300 pgm dispatch nightly wormhole_b0
No files were found with the provided path: generated/test_reports/. No artifacts will be uploaded.
fd-nightly / Nightly N300 mamba
No files were found with the provided path: generated/test_reports/. No artifacts will be uploaded.
disk-usage-before-startup
Disk usage is 71 %
disk-usage-after-startup
Disk usage is 71 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 84 %
disk-usage-after-startup
Disk usage is 84 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 84 %
disk-usage-after-startup
Disk usage is 84 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 72 %
disk-usage-after-startup
Disk usage is 72 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 77 %
disk-usage-after-startup
Disk usage is 77 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 90 %
disk-usage-after-startup
Disk usage is 90 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 84 %
disk-usage-after-startup
Disk usage is 84 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 84 %
disk-usage-after-startup
Disk usage is 84 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 77 %
disk-usage-after-startup
Disk usage is 77 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 70 %
disk-usage-after-startup
Disk usage is 70 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 85 %
disk-usage-after-startup
Disk usage is 85 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 83 %
disk-usage-after-startup
Disk usage is 83 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 82 %
disk-usage-after-startup
Disk usage is 82 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 73 %
disk-usage-after-startup
Disk usage is 73 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 71 %
disk-usage-after-startup
Disk usage is 71 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 57 %
disk-usage-after-startup
Disk usage is 57 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 47 %
disk-usage-after-startup
Disk usage is 47 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 80 %
disk-usage-after-startup
Disk usage is 80 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 83 %
disk-usage-after-startup
Disk usage is 83 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 83 %
disk-usage-after-startup
Disk usage is 83 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful

Artifacts

Produced during runtime
Name Size
TTMetal_build_grayskull
230 MB
TTMetal_build_wormhole_b0
230 MB
test_reports_0118094c-5177-4bbf-84cd-4177ae0a05cd
3.18 KB
test_reports_0a0529f3-c760-4d84-8c50-5b18238a43f6
742 Bytes
test_reports_1102068d-b2cc-47e6-8c2f-62c701a10a87
552 Bytes
test_reports_1cd34922-cb93-43b5-a22c-fca0fead34e7
4.61 KB
test_reports_2c201ee9-8882-409b-94a8-ce3f3c9729a5
6.62 KB
test_reports_2f4b1d2f-157b-4a59-9b35-3e1d86a2a2e0
1.34 KB
test_reports_33d0c629-fe10-4dfa-8e8c-fc164e04b3e9
6.16 KB
test_reports_513f60f8-768e-4d94-aa18-078c7ddc2ff1
1.13 KB
test_reports_515e3d1b-3e68-4281-b716-4dd19411dc12
551 Bytes
test_reports_5424e56e-07f3-4472-9713-2f1c5000d334
1.36 KB
test_reports_55b41754-abde-4595-bfd8-38527cc9a1f2
5.9 KB
test_reports_627a0292-944c-42d8-bdf9-07e5357b7a5a
1.12 KB
test_reports_7070e56d-3f32-40f4-96e5-9243b88a3577
477 Bytes
test_reports_8056a7e8-72ce-46bd-b9ee-2dffdf0b64fc
607 Bytes
test_reports_8eb03b54-df7b-4514-9e68-d9667f4bbaf7
1.02 KB
test_reports_a16b5c5f-46ed-47aa-9b24-4e2895291ad4
431 Bytes
test_reports_b50a085c-bb93-4e21-9d88-07a6355dd35d
626 Bytes
test_reports_b6c0e410-4a1b-48a8-a0d2-e10435c325f5
475 Bytes
test_reports_cf0f71fa-eed5-4082-9054-f6a7e8f3f633
430 Bytes
test_reports_dc348d2f-2c07-487a-822f-ea4fec76d39f
610 Bytes
test_reports_df7f0fc9-cf58-4e09-beb2-d8e48dc7e7a3
479 Bytes