Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bench] Add code to run multiple command lines and export the result in a csv file #1641

Merged
merged 17 commits into from
Jul 3, 2024

Merge branch 'main' of https://github.com/microsoft/onnxscript into bbb

7019d1d
Select commit
Loading
Failed to load commit list.
Merged

[bench] Add code to run multiple command lines and export the result in a csv file #1641

Merge branch 'main' of https://github.com/microsoft/onnxscript into bbb
7019d1d
Select commit
Loading
Failed to load commit list.
Codecov / codecov/project succeeded Jun 28, 2024 in 0s

65.60% (-10.69%) compared to be00339

View this Pull Request on Codecov

65.60% (-10.69%) compared to be00339

Details

Codecov Report

Attention: Patch coverage is 29.64824% with 140 lines in your changes missing coverage. Please review.

Project coverage is 65.60%. Comparing base (be00339) to head (7019d1d).

❗ Current head 7019d1d differs from pull request most recent head 31e8c0d

Please upload reports for the commit 31e8c0d to get more accurate results.

Files Patch % Lines
onnxscript/tools/benchmark/benchmark_run.py 17.07% 68 Missing ⚠️
onnxscript/tools/benchmark/export_model.py 36.06% 34 Missing and 5 partials ⚠️
onnxscript/tools/benchmark/benchmark_helpers.py 31.11% 31 Missing ⚠️
...nxscript/tools/benchmark/benchmark_helpers_test.py 81.81% 1 Missing and 1 partial ⚠️

❗ There is a different number of reports uploaded between BASE (be00339) and HEAD (7019d1d). Click for more details.

HEAD has 56 uploads less than BASE | Flag | BASE (be00339) | HEAD (7019d1d) | |------|------|------| ||60|4|
Additional details and impacted files 
@@             Coverage Diff             @@
##             main    #1641       +/-   ##
===========================================
- Coverage   76.29%   65.60%   -10.69%     
===========================================
  Files         240      242        +2     
  Lines       25496    25645      +149     
  Branches     4550     4578       +28     
===========================================
- Hits        19451    16824     -2627     
- Misses       5158     7978     +2820     
+ Partials      887      843       -44

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

View more details on Codecov