Skip to content

Commit

Permalink
Add note about test reference value.
Browse files Browse the repository at this point in the history
  • Loading branch information
ScottTodd committed Jan 7, 2025
1 parent 1034f8a commit 659734b
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions shortfin/tests/invocation/mobilenet_program_test.py
Original file line number Diff line number Diff line change
Expand Up @@ -74,6 +74,9 @@ async def assert_mobilenet_ref_output(device, device_output):
absmean = functools.reduce(
lambda x, y: x + abs(y) / len(flat_output), flat_output, 0.0
)
# Note: this value was just copied from a sample run of the test.
# Comparison against a reference backend for this model is tested upstream
# in https://github.com/iree-org/iree-test-suites/tree/main/onnx_models.
assert absmean == pytest.approx(0.81196929)


Expand Down

0 comments on commit 659734b

Please sign in to comment.