Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bench] Add code to run multiple command lines and export the result in a csv file #1641

Merged
merged 17 commits into from
Jul 3, 2024

Merge branch 'main' into bbb

b1878e0
Select commit
Loading
Failed to load commit list.
Merged

[bench] Add code to run multiple command lines and export the result in a csv file #1641

Merge branch 'main' into bbb
b1878e0
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch succeeded Jul 3, 2024 in 1s

30.00% of diff hit (target 75.56%)

View this Pull Request on Codecov

30.00% of diff hit (target 75.56%)

Annotations

Check warning on line 215 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L214-L215

Added lines #L214 - L215 were not covered by tests

Check warning on line 218 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L218

Added line #L218 was not covered by tests

Check warning on line 221 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L220-L221

Added lines #L220 - L221 were not covered by tests

Check warning on line 224 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L223-L224

Added lines #L223 - L224 were not covered by tests

Check warning on line 227 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L226-L227

Added lines #L226 - L227 were not covered by tests

Check warning on line 231 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L231

Added line #L231 was not covered by tests

Check warning on line 234 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L234

Added line #L234 was not covered by tests

Check warning on line 242 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L237-L242

Added lines #L237 - L242 were not covered by tests

Check warning on line 724 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L724

Added line #L724 was not covered by tests

Check warning on line 729 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L729

Added line #L729 was not covered by tests

Check warning on line 738 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L736-L738

Added lines #L736 - L738 were not covered by tests

Check warning on line 781 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L781

Added line #L781 was not covered by tests

Check warning on line 783 in onnxscript/tools/benchmark/benchmark_helpers.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers.py#L783

Added line #L783 was not covered by tests

Check warning on line 53 in onnxscript/tools/benchmark/benchmark_helpers_test.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_helpers_test.py#L53

Added line #L53 was not covered by tests

Check warning on line 20 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L20

Added line #L20 was not covered by tests

Check warning on line 30 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L27-L30

Added lines #L27 - L30 were not covered by tests

Check warning on line 32 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L32

Added line #L32 was not covered by tests

Check warning on line 36 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L34-L36

Added lines #L34 - L36 were not covered by tests

Check warning on line 40 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L40

Added line #L40 was not covered by tests

Check warning on line 44 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L42-L44

Added lines #L42 - L44 were not covered by tests

Check warning on line 49 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L48-L49

Added lines #L48 - L49 were not covered by tests

Check warning on line 52 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L51-L52

Added lines #L51 - L52 were not covered by tests

Check warning on line 57 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L56-L57

Added lines #L56 - L57 were not covered by tests

Check warning on line 80 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L79-L80

Added lines #L79 - L80 were not covered by tests

Check warning on line 84 in onnxscript/tools/benchmark/benchmark_run.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

onnxscript/tools/benchmark/benchmark_run.py#L82-L84

Added lines #L82 - L84 were not covered by tests