Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add microbenchmark for layer normalization and improve latency #22223

Merged
merged 36 commits into from
Oct 15, 2024

switch to IAllocator::MakeUniquePtr

57c3e63
Select commit
Loading
Failed to load commit list.
Merged

Add microbenchmark for layer normalization and improve latency #22223

switch to IAllocator::MakeUniquePtr
57c3e63
Select commit
Loading
Failed to load commit list.
Azure Pipelines / ONNX Runtime Web CI Pipeline succeeded Oct 14, 2024 in 37m 45s

Build #20241014.16 had test failures

Details

Tests

  • Failed: 1 (0.01%)
  • Passed: 8,407 (99.77%)
  • Other: 18 (0.21%)
  • Total: 8,426

Annotations

Check failure on line 1 in LayerNorm_Scale_Bias_Float16InputScaleBiasOutput

See this annotation in the file changed.

@azure-pipelines azure-pipelines / ONNX Runtime Web CI Pipeline

LayerNorm_Scale_Bias_Float16InputScaleBiasOutput

/mnt/vss/_work/1/s/onnxruntime/test/providers/checkers.cc:437
The difference between f_expected[i] and f_actual[i] is inf, which exceeds tolerance, where
f_expected[i] evaluates to -0.051788330078125,
f_actual[i] evaluates to inf, and
tolerance evaluates to 0.0025517882313579321.
i:2
Google Test trace:
/mnt/vss/_work/1/s/onnxruntime/test/providers/checkers.cc:568: provider type: CPUExecutionProvider
/mnt/vss/_work/1/s/onnxruntime/test/providers/base_tester.cc:830: registered execution providers: CPUExecutionProvider
Raw output
/mnt/vss/_work/1/s/onnxruntime/test/providers/checkers.cc:437
The difference between f_expected[i] and f_actual[i] is inf, which exceeds tolerance, where
f_expected[i] evaluates to -0.051788330078125,
f_actual[i] evaluates to inf, and
tolerance evaluates to 0.0025517882313579321.
i:2
Google Test trace:
/mnt/vss/_work/1/s/onnxruntime/test/providers/checkers.cc:568: provider type: CPUExecutionProvider
/mnt/vss/_work/1/s/onnxruntime/test/providers/base_tester.cc:830: registered execution providers: CPUExecutionProvider