Skip to content

(Single-card) Model perf tests #6247

(Single-card) Model perf tests

(Single-card) Model perf tests #6247

Triggered via schedule November 14, 2024 14:00
Status Failure
Total duration 2h 3m 57s
Artifacts 6

perf-models.yaml

on: schedule
build-artifact  /  ...  /  build-docker-image
21s
build-artifact / build-docker-image / build-docker-image
Matrix: build-artifact / build-artifact
Matrix: models-perf / models-perf
Fit to window
Zoom out
Zoom in

Annotations

6 errors and 49 notices
pcie-cards-are-being-used-cleanup
Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully. This can happen if a test hung and is normally an issue with the test, rather than infra.
models-perf / other GS
Process completed with exit code 1.
models-perf / other GS
Process completed with exit code 2.
models-perf / other GS
The action 'Run performance regressions' has timed out after 70 minutes.
models-perf / llm_javelin GS
Process completed with exit code 2.
models-perf / llm_javelin GS
Process completed with exit code 1.
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 86 %
disk-usage-after-startup
Disk usage is 86 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 83 %
disk-usage-after-startup
Disk usage is 83 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 83 %
disk-usage-after-startup
Disk usage is 83 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 28 %
disk-usage-after-startup
Disk usage is 28 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 57 %
disk-usage-after-startup
Disk usage is 57 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 28 %
disk-usage-after-startup
Disk usage is 28 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
printing-out-smi-info-cleanup
Touching and printing out SMI info
successful-reset-cleanup
tt-smi reset was successful
reset-successful-cleanup
tt-smi reset was successful
disk-usage-before-startup
Disk usage is 28 %
disk-usage-after-startup
Disk usage is 28 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful

Artifacts

Produced during runtime
Name Size
TTMetal_build_grayskull
230 MB
TTMetal_build_wormhole_b0
230 MB
perf-report-csv-cnn_javelin-grayskull-bare_metal
332 Bytes
perf-report-csv-cnn_javelin-wormhole_b0-bare_metal
493 Bytes
perf-report-csv-llm_javelin-wormhole_b0-bare_metal
1.32 KB
perf-report-csv-other-wormhole_b0-bare_metal
700 Bytes