Skip to content

(T3K) T3000 model perf tests #1104

(T3K) T3000 model perf tests

(T3K) T3000 model perf tests #1104

Triggered via schedule November 5, 2024 00:22
Status Failure
Total duration 1d 6h 42m 45s
Artifacts 2
build-artifact  /  ...  /  build-docker-image
34s
build-artifact / build-docker-image / build-docker-image
Matrix: build-artifact / build-artifact
Matrix: t3000-model-perf-tests / t3000-model-perf-tests
Fit to window
Zoom out
Zoom in

Annotations

6 errors, 9 warnings, and 1 notice
t3000-model-perf-tests / t3k CNN resnet50 model perf tests
This request was automatically failed because there were no enabled runners online to process the request for more than 1 days.
t3000-model-perf-tests / t3k LLM llama2 model perf tests
This request was automatically failed because there were no enabled runners online to process the request for more than 1 days.
t3000-model-perf-tests / t3k LLM llama3 model perf tests
This request was automatically failed because there were no enabled runners online to process the request for more than 1 days.
t3000-model-perf-tests / t3k LLM falcon7b model perf tests
This request was automatically failed because there were no enabled runners online to process the request for more than 1 days.
t3000-model-perf-tests / t3k LLM mixtral model perf tests
This request was automatically failed because there were no enabled runners online to process the request for more than 1 days.
t3000-model-perf-tests / t3k LLM falcon40b model perf tests
The job running on runner tt-metal-ci-bm-t3k-f10cs08 has exceeded the maximum execution time of 360 minutes.
t3000-model-perf-tests / t3k LLM falcon40b model perf tests
Runner tt-metal-ci-bm-t3k-f10cs08 did not respond to a cancelation request with 00:05:00.
unsuccessful-reset-attempt-cleanup
Unsuccessful board reset, trying again in 1 minute ...
unsuccessful-reset-attempt-cleanup
Unsuccessful board reset, trying again in 1 minute ...
unsuccessful-reset-attempt-cleanup
Unsuccessful board reset, trying again in 1 minute ...
unsuccessful-reset-attempt-cleanup
Unsuccessful board reset, trying again in 1 minute ...
unsuccessful-reset-attempt-cleanup
Unsuccessful board reset, trying again in 1 minute ...
unsuccessful-reset-attempt-cleanup
Unsuccessful board reset, trying again in 1 minute ...
unsuccessful-reset-attempt-cleanup
Unsuccessful board reset, trying again in 1 minute ...
unsuccessful-reset-attempt-cleanup
Unsuccessful board reset, trying again in 1 minute ...
printing-out-smi-info-cleanup
Touching and printing out SMI info

Artifacts

Produced during runtime
Name Size
TTMetal_build_wormhole_b0
56.9 MB
perf-report-csv-LLM-wormhole_b0-falcon40b-bare-metal
654 Bytes