init #315
This run and associated checks have been archived and are scheduled for deletion.
Learn more about checks retention
benchmarks.yml
on: push
CPU Pytest benchmark
7m 15s
Matrix: GPU Pytest benchmark
Annotations
2 errors and 10 warnings
CPU Pytest benchmark
# :warning: **Performance Alert** :warning:
Possible performance regression was detected for benchmark **'CPU Benchmark Results'**.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`.
| Benchmark suite | Current: a3595f4a9cb4da3404fd5427367451f434ebd68b | Previous: 9865dec3d3e68ac45c5f2c455b2d79ec54f12721 | Ratio |
|-|-|-|-|
| `benchmarks/common/common_ops_test.py::test_plain_set_stack_nested` | `3419.7137298629254` iter/sec (`stddev: 0.0003991740607016415`) | `7102.635672018859` iter/sec (`stddev: 0.000003490104581926313`) | `2.08` |
| `benchmarks/common/common_ops_test.py::test_items_stack_nested_locked` | `656.343150461759` iter/sec (`stddev: 0.0003111802618047426`) | `1331.741397657034` iter/sec (`stddev: 0.000030312527898759866`) | `2.03` |
| `benchmarks/common/common_ops_test.py::test_keys_stack_nested_locked` | `788.6443206913364` iter/sec (`stddev: 0.0003061982749919703`) | `1626.0407392109466` iter/sec (`stddev: 0.000012775485021631076`) | `2.06` |
| `benchmarks/common/common_ops_test.py::test_values_stack_nested_locked` | `955.063108522064` iter/sec (`stddev: 0.0004743697892677344`) | `2064.2310412001884` iter/sec (`stddev: 0.000012551582401382587`) | `2.16` |
| `benchmarks/common/common_ops_test.py::test_setitem_dim[int]` | `17219.6549339233` iter/sec (`stddev: 0.000035878887277692905`) | `37081.704008478664` iter/sec (`stddev: 0.0000019449480172614492`) | `2.15` |
| `benchmarks/common/common_ops_test.py::test_setitem_dim[slice_int]` | `8719.754485117723` iter/sec (`stddev: 0.00006578131347708857`) | `19100.86607737998` iter/sec (`stddev: 0.000007366987788507623`) | `2.19` |
| `benchmarks/common/common_ops_test.py::test_setitem_dim[tuple]` | `11436.732419311986` iter/sec (`stddev: 0.0000488122632059882`) | `24645.2337086472` iter/sec (`stddev: 0.000003389822100687616`) | `2.15` |
| `benchmarks/common/common_ops_test.py::test_unbind_speed_stack1` | `644461.6098652725` iter/sec (`stddev: 0.00003056490032461228`) | `1670689.808577556` iter/sec (`stddev: 2.3238120703907647e-8`) | `2.59` |
| `benchmarks/common/memmap_benchmarks_test.py::test_creation[device0]` | `1504.858172785846` iter/sec (`stddev: 0.0006393396980101482`) | `3439.973939450101` iter/sec (`stddev: 0.00009263139975944315`) | `2.29` |
| `benchmarks/common/memmap_benchmarks_test.py::test_creation_from_tensor` | `1422.4732601074566` iter/sec (`stddev: 0.0003778617584150533`) | `3130.170212285269` iter/sec (`stddev: 0.000013151245167648012`) | `2.20` |
| `benchmarks/common/memmap_benchmarks_test.py::test_add_one[memmap_tensor0]` | `14247.64631363357` iter/sec (`stddev: 0.00007170766678251406`) | `39703.09957082932` iter/sec (`stddev: 0.000005248389106894473`) | `2.79` |
| `benchmarks/common/memmap_benchmarks_test.py::test_contiguous[memmap_tensor0]` | `70766.9207073084` iter/sec (`stddev: 0.00007593331906997162`) | `173922.50384782036` iter/sec (`stddev: 5.62562376421342e-7`) | `2.46` |
| `benchmarks/common/memmap_benchmarks_test.py::test_stack[memmap_tensor0]` | `20414.372737045724` iter/sec (`stddev: 0.00004487886673659763`) | `54588.99227440141` iter/sec (`stddev: 0.0000016336264114157033`) | `2.67` |
| `benchmarks/common/memmap_benchmarks_test.py::test_memmaptd_index_astensor` | `465.69216765587333` iter/sec (`stddev: 0.000585917326871396`) | `1090.650647915972` iter/sec (`stddev: 0.000018371014635300354`) | `2.34` |
| `benchmarks/common/memmap_benchmarks_test.py::test_memmaptd_index_op` | `172.08119090954335` iter/sec (`stddev: 0.0014806015309059626`) | `446.8523829858738` iter/sec (`stddev: 0.00006864059888340528`) | `2.60` |
| `benchmarks/common/pytree_benchmarks_test.py::test_add_pytree` | `12358.153554517876` iter/sec (`stddev: 0.00011198467990816379`) | `30554.01449889499` iter/sec (`stddev: 0.000003242521013973305`) | `2.47` |
| `benchmarks/common/pytree_benchmarks_test.py::test_add_td` | `8460.561779317395` iter/sec (`stddev: 0.0001071044659562639`) | `17428.648656598485` iter/sec (`stddev: 0.0000033848856519431052`) | `2.06` |
| `benchmarks/nn/functional_benchmarks_test.py::test_exec_functo
|
GPU Pytest benchmark (linux.4xlarge.nvidia.gpu, 3.8)
Process completed with exit code 2.
|
CPU Pytest benchmark
Performance alert! Previous value was 7102.635672018859 and current value is 3419.7137298629254. It is 2.0769679081598325x worse than previous exceeding a ratio threshold 2
|
CPU Pytest benchmark
Performance alert! Previous value was 1331.741397657034 and current value is 656.343150461759. It is 2.029032216943393x worse than previous exceeding a ratio threshold 2
|
CPU Pytest benchmark
Performance alert! Previous value was 1626.0407392109466 and current value is 788.6443206913364. It is 2.0618175983129343x worse than previous exceeding a ratio threshold 2
|
CPU Pytest benchmark
Performance alert! Previous value was 2064.2310412001884 and current value is 955.063108522064. It is 2.161355645277236x worse than previous exceeding a ratio threshold 2
|
CPU Pytest benchmark
Performance alert! Previous value was 37081.704008478664 and current value is 17219.6549339233. It is 2.1534522120664836x worse than previous exceeding a ratio threshold 2
|
CPU Pytest benchmark
Performance alert! Previous value was 19100.86607737998 and current value is 8719.754485117723. It is 2.1905279684170034x worse than previous exceeding a ratio threshold 2
|
CPU Pytest benchmark
Performance alert! Previous value was 24645.2337086472 and current value is 11436.732419311986. It is 2.15491915042372x worse than previous exceeding a ratio threshold 2
|
CPU Pytest benchmark
Performance alert! Previous value was 1670689.808577556 and current value is 644461.6098652725. It is 2.592380652319726x worse than previous exceeding a ratio threshold 2
|
CPU Pytest benchmark
Performance alert! Previous value was 3439.973939450101 and current value is 1504.858172785846. It is 2.2859123880637213x worse than previous exceeding a ratio threshold 2
|
CPU Pytest benchmark
Performance alert! Previous value was 3130.170212285269 and current value is 1422.4732601074566. It is 2.2005125158196712x worse than previous exceeding a ratio threshold 2
|