[bench] Add code to run multiple command lines and export the result in a csv file #1641
30.00% of diff hit (target 75.56%)
View this Pull Request on Codecov
30.00% of diff hit (target 75.56%)
Annotations
Check warning on line 215 in onnxscript/tools/benchmark/benchmark_helpers.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_helpers.py#L214-L215
Added lines #L214 - L215 were not covered by tests
Check warning on line 218 in onnxscript/tools/benchmark/benchmark_helpers.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_helpers.py#L218
Added line #L218 was not covered by tests
Check warning on line 221 in onnxscript/tools/benchmark/benchmark_helpers.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_helpers.py#L220-L221
Added lines #L220 - L221 were not covered by tests
Check warning on line 224 in onnxscript/tools/benchmark/benchmark_helpers.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_helpers.py#L223-L224
Added lines #L223 - L224 were not covered by tests
Check warning on line 227 in onnxscript/tools/benchmark/benchmark_helpers.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_helpers.py#L226-L227
Added lines #L226 - L227 were not covered by tests
Check warning on line 231 in onnxscript/tools/benchmark/benchmark_helpers.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_helpers.py#L231
Added line #L231 was not covered by tests
Check warning on line 234 in onnxscript/tools/benchmark/benchmark_helpers.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_helpers.py#L234
Added line #L234 was not covered by tests
Check warning on line 242 in onnxscript/tools/benchmark/benchmark_helpers.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_helpers.py#L237-L242
Added lines #L237 - L242 were not covered by tests
Check warning on line 724 in onnxscript/tools/benchmark/benchmark_helpers.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_helpers.py#L724
Added line #L724 was not covered by tests
Check warning on line 729 in onnxscript/tools/benchmark/benchmark_helpers.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_helpers.py#L729
Added line #L729 was not covered by tests
Check warning on line 738 in onnxscript/tools/benchmark/benchmark_helpers.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_helpers.py#L736-L738
Added lines #L736 - L738 were not covered by tests
Check warning on line 781 in onnxscript/tools/benchmark/benchmark_helpers.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_helpers.py#L781
Added line #L781 was not covered by tests
Check warning on line 783 in onnxscript/tools/benchmark/benchmark_helpers.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_helpers.py#L783
Added line #L783 was not covered by tests
Check warning on line 53 in onnxscript/tools/benchmark/benchmark_helpers_test.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_helpers_test.py#L53
Added line #L53 was not covered by tests
Check warning on line 20 in onnxscript/tools/benchmark/benchmark_run.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_run.py#L20
Added line #L20 was not covered by tests
Check warning on line 30 in onnxscript/tools/benchmark/benchmark_run.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_run.py#L27-L30
Added lines #L27 - L30 were not covered by tests
Check warning on line 32 in onnxscript/tools/benchmark/benchmark_run.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_run.py#L32
Added line #L32 was not covered by tests
Check warning on line 36 in onnxscript/tools/benchmark/benchmark_run.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_run.py#L34-L36
Added lines #L34 - L36 were not covered by tests
Check warning on line 40 in onnxscript/tools/benchmark/benchmark_run.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_run.py#L40
Added line #L40 was not covered by tests
Check warning on line 44 in onnxscript/tools/benchmark/benchmark_run.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_run.py#L42-L44
Added lines #L42 - L44 were not covered by tests
Check warning on line 49 in onnxscript/tools/benchmark/benchmark_run.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_run.py#L48-L49
Added lines #L48 - L49 were not covered by tests
Check warning on line 52 in onnxscript/tools/benchmark/benchmark_run.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_run.py#L51-L52
Added lines #L51 - L52 were not covered by tests
Check warning on line 57 in onnxscript/tools/benchmark/benchmark_run.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_run.py#L56-L57
Added lines #L56 - L57 were not covered by tests
Check warning on line 80 in onnxscript/tools/benchmark/benchmark_run.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_run.py#L79-L80
Added lines #L79 - L80 were not covered by tests
Check warning on line 84 in onnxscript/tools/benchmark/benchmark_run.py
codecov / codecov/patch
onnxscript/tools/benchmark/benchmark_run.py#L82-L84
Added lines #L82 - L84 were not covered by tests