Skip to content

Nightly fast dispatch tests #5762

Nightly fast dispatch tests

Nightly fast dispatch tests #5762

Manually triggered November 13, 2024 23:26
Status Failure
Total duration 1h 21m 39s
Artifacts 22
build-artifact  /  ...  /  build-docker-image
21s
build-artifact / build-docker-image / build-docker-image
Matrix: build-artifact / build-artifact
Matrix: fd-nightly / fd-nightly
Matrix: fd-nightly / nightly-wh-models
Fit to window
Zoom out
Zoom in

Annotations

8 errors, 1 warning, and 136 notices
fd-nightly / Nightly N150 common_models
The self-hosted runner: tt-metal-ci-vm-134 lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.
fd-nightly / FD GS ttnn nightly grayskull
Process completed with exit code 1.
fd-nightly / Nightly N150 mamba
The self-hosted runner: tt-metal-ci-vm-115 lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.
fd-nightly / Nightly N150 mamba
The action 'Run frequent reg tests scripts' has timed out after 50 minutes.
pcie-cards-are-being-used-cleanup
Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully. This can happen if a test hung and is normally an issue with the test, rather than infra.
fd-nightly / Nightly N300 mamba
The self-hosted runner: tt-metal-ci-vm-22 lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.
pcie-cards-are-being-used-cleanup
Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully. This can happen if a test hung and is normally an issue with the test, rather than infra.
fd-nightly / Nightly N300 mamba
The action 'Run frequent reg tests scripts' has timed out after 50 minutes.
fd-nightly / FD WH N300 pgm dispatch nightly wormhole_b0
No files were found with the provided path: generated/test_reports/. No artifacts will be uploaded.
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 81 %
disk-usage-after-startup
Disk usage is 81 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 58 %
disk-usage-after-startup
Disk usage is 58 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 83 %
disk-usage-after-startup
Disk usage is 83 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 82 %
disk-usage-after-startup
Disk usage is 82 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 85 %
disk-usage-after-startup
Disk usage is 85 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 84 %
disk-usage-after-startup
Disk usage is 84 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 49 %
disk-usage-after-startup
Disk usage is 49 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 56 %
disk-usage-after-startup
Disk usage is 56 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 83 %
disk-usage-after-startup
Disk usage is 83 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 86 %
disk-usage-after-startup
Disk usage is 86 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 70 %
disk-usage-after-startup
Disk usage is 70 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 77 %
disk-usage-after-startup
Disk usage is 77 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 53 %
disk-usage-after-startup
Disk usage is 53 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 86 %
disk-usage-after-startup
Disk usage is 86 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 70 %
disk-usage-after-startup
Disk usage is 70 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 82 %
disk-usage-after-startup
Disk usage is 82 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 86 %
disk-usage-after-startup
Disk usage is 86 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 78 %
disk-usage-after-startup
Disk usage is 78 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
disk-usage-before-startup
Disk usage is 84 %
disk-usage-after-startup
Disk usage is 84 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 71 %
disk-usage-after-startup
Disk usage is 71 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info

Artifacts

Produced during runtime
Name Size
TTMetal_build_grayskull
230 MB
TTMetal_build_wormhole_b0
231 MB
test_reports_03c0e99f-6b32-451c-a795-7fb9b1af3c18
484 Bytes
test_reports_0ac5b9ac-6c57-4384-808a-e17ed1942849
621 Bytes
test_reports_0d3fa18b-f60a-426c-95f0-80dc13ca3077
613 Bytes
test_reports_22af028c-d8a7-4f4b-a4b7-570f1e7797e9
477 Bytes
test_reports_45ca6700-835b-4efa-828a-1bc7d55dad00
1.32 KB
test_reports_4ec42bc2-560d-4074-9a82-913b2542ab43
1.35 KB
test_reports_70023966-d1c1-4bc2-814d-32b402bec83a
549 Bytes
test_reports_7187e221-623d-4afe-adc5-caf4a7d7a3a5
4.57 KB
test_reports_741ce3e7-1264-42e8-9201-4c590dd3766f
429 Bytes
test_reports_7789d38e-1b26-4d04-bc7b-47571df2f662
478 Bytes
test_reports_8c8cb83d-758f-49ea-894d-da404991316e
1.12 KB
test_reports_91f0da1e-8399-484f-a723-797bffb4a8a5
5.92 KB
test_reports_9656fdd0-50f8-4749-8587-f7d98131856a
608 Bytes
test_reports_973c9629-9603-4262-9c4b-52674aeb531d
1.03 KB
test_reports_97655a83-487e-457d-8e53-441fdf676dfd
6.61 KB
test_reports_b0605cbb-3466-4a92-8178-355a58b94893
5.91 KB
test_reports_b7a8879b-ab21-47da-9d3a-771729c7e35f
550 Bytes
test_reports_c64271cb-caf2-4cc7-9417-dafc35be640e
430 Bytes
test_reports_e4563e23-d53b-4369-9bea-01d4b1d750ef
623 Bytes
test_reports_e9299d9e-28e0-4652-b334-5dde91556d96
4.6 KB