Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bench] Add code to run multiple command lines and export the result in a csv file #1641

Merged
merged 17 commits into from
Jul 3, 2024

Merge branch 'main' of https://github.com/microsoft/onnxscript into bbb

7019d1d
Select commit
Loading
Failed to load commit list.
Merged

[bench] Add code to run multiple command lines and export the result in a csv file #1641

Merge branch 'main' of https://github.com/microsoft/onnxscript into bbb
7019d1d
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch succeeded Jun 28, 2024 in 1s

29.64% of diff hit (target 76.29%)

View this Pull Request on Codecov

29.64% of diff hit (target 76.29%)

Annotations

Check warning on line 214 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L213-L214

Added lines #L213 - L214 were not covered by tests

Check warning on line 217 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L217

Added line #L217 was not covered by tests

Check warning on line 220 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L219-L220

Added lines #L219 - L220 were not covered by tests

Check warning on line 223 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L222-L223

Added lines #L222 - L223 were not covered by tests

Check warning on line 226 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L225-L226

Added lines #L225 - L226 were not covered by tests

Check warning on line 230 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L230

Added line #L230 was not covered by tests

Check warning on line 233 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L233

Added line #L233 was not covered by tests

Check warning on line 241 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L236-L241

Added lines #L236 - L241 were not covered by tests

Check warning on line 723 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L723

Added line #L723 was not covered by tests

Check warning on line 728 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L728

Added line #L728 was not covered by tests

Check warning on line 737 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L735-L737

Added lines #L735 - L737 were not covered by tests

Check warning on line 780 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L780

Added line #L780 was not covered by tests

Check warning on line 782 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L782

Added line #L782 was not covered by tests

Check warning on line 53 in onnxscript/tools/benchmark/benchmark_helpers_test.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers_test.py#L53

Added line #L53 was not covered by tests

Check warning on line 20 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L20

Added line #L20 was not covered by tests

Check warning on line 30 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L27-L30

Added lines #L27 - L30 were not covered by tests

Check warning on line 32 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L32

Added line #L32 was not covered by tests

Check warning on line 36 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L34-L36

Added lines #L34 - L36 were not covered by tests

Check warning on line 40 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L40

Added line #L40 was not covered by tests

Check warning on line 44 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L42-L44

Added lines #L42 - L44 were not covered by tests

Check warning on line 49 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L48-L49

Added lines #L48 - L49 were not covered by tests

Check warning on line 52 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L51-L52

Added lines #L51 - L52 were not covered by tests

Check warning on line 57 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L56-L57

Added lines #L56 - L57 were not covered by tests

Check warning on line 80 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L79-L80

Added lines #L79 - L80 were not covered by tests

Check warning on line 84 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L82-L84

Added lines #L82 - L84 were not covered by tests