Skip to content
Triggered via push November 3, 2023 08:09
Status Failure
Total duration 8m 4s
Artifacts
This run and associated checks have been archived and are scheduled for deletion. Learn more about checks retention

benchmarks.yml

on: push
CPU Pytest benchmark
7m 15s
CPU Pytest benchmark
Matrix: GPU Pytest benchmark
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 10 warnings
CPU Pytest benchmark
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'CPU Benchmark Results'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`. | Benchmark suite | Current: a3595f4a9cb4da3404fd5427367451f434ebd68b | Previous: 9865dec3d3e68ac45c5f2c455b2d79ec54f12721 | Ratio | |-|-|-|-| | `benchmarks/common/common_ops_test.py::test_plain_set_stack_nested` | `3419.7137298629254` iter/sec (`stddev: 0.0003991740607016415`) | `7102.635672018859` iter/sec (`stddev: 0.000003490104581926313`) | `2.08` | | `benchmarks/common/common_ops_test.py::test_items_stack_nested_locked` | `656.343150461759` iter/sec (`stddev: 0.0003111802618047426`) | `1331.741397657034` iter/sec (`stddev: 0.000030312527898759866`) | `2.03` | | `benchmarks/common/common_ops_test.py::test_keys_stack_nested_locked` | `788.6443206913364` iter/sec (`stddev: 0.0003061982749919703`) | `1626.0407392109466` iter/sec (`stddev: 0.000012775485021631076`) | `2.06` | | `benchmarks/common/common_ops_test.py::test_values_stack_nested_locked` | `955.063108522064` iter/sec (`stddev: 0.0004743697892677344`) | `2064.2310412001884` iter/sec (`stddev: 0.000012551582401382587`) | `2.16` | | `benchmarks/common/common_ops_test.py::test_setitem_dim[int]` | `17219.6549339233` iter/sec (`stddev: 0.000035878887277692905`) | `37081.704008478664` iter/sec (`stddev: 0.0000019449480172614492`) | `2.15` | | `benchmarks/common/common_ops_test.py::test_setitem_dim[slice_int]` | `8719.754485117723` iter/sec (`stddev: 0.00006578131347708857`) | `19100.86607737998` iter/sec (`stddev: 0.000007366987788507623`) | `2.19` | | `benchmarks/common/common_ops_test.py::test_setitem_dim[tuple]` | `11436.732419311986` iter/sec (`stddev: 0.0000488122632059882`) | `24645.2337086472` iter/sec (`stddev: 0.000003389822100687616`) | `2.15` | | `benchmarks/common/common_ops_test.py::test_unbind_speed_stack1` | `644461.6098652725` iter/sec (`stddev: 0.00003056490032461228`) | `1670689.808577556` iter/sec (`stddev: 2.3238120703907647e-8`) | `2.59` | | `benchmarks/common/memmap_benchmarks_test.py::test_creation[device0]` | `1504.858172785846` iter/sec (`stddev: 0.0006393396980101482`) | `3439.973939450101` iter/sec (`stddev: 0.00009263139975944315`) | `2.29` | | `benchmarks/common/memmap_benchmarks_test.py::test_creation_from_tensor` | `1422.4732601074566` iter/sec (`stddev: 0.0003778617584150533`) | `3130.170212285269` iter/sec (`stddev: 0.000013151245167648012`) | `2.20` | | `benchmarks/common/memmap_benchmarks_test.py::test_add_one[memmap_tensor0]` | `14247.64631363357` iter/sec (`stddev: 0.00007170766678251406`) | `39703.09957082932` iter/sec (`stddev: 0.000005248389106894473`) | `2.79` | | `benchmarks/common/memmap_benchmarks_test.py::test_contiguous[memmap_tensor0]` | `70766.9207073084` iter/sec (`stddev: 0.00007593331906997162`) | `173922.50384782036` iter/sec (`stddev: 5.62562376421342e-7`) | `2.46` | | `benchmarks/common/memmap_benchmarks_test.py::test_stack[memmap_tensor0]` | `20414.372737045724` iter/sec (`stddev: 0.00004487886673659763`) | `54588.99227440141` iter/sec (`stddev: 0.0000016336264114157033`) | `2.67` | | `benchmarks/common/memmap_benchmarks_test.py::test_memmaptd_index_astensor` | `465.69216765587333` iter/sec (`stddev: 0.000585917326871396`) | `1090.650647915972` iter/sec (`stddev: 0.000018371014635300354`) | `2.34` | | `benchmarks/common/memmap_benchmarks_test.py::test_memmaptd_index_op` | `172.08119090954335` iter/sec (`stddev: 0.0014806015309059626`) | `446.8523829858738` iter/sec (`stddev: 0.00006864059888340528`) | `2.60` | | `benchmarks/common/pytree_benchmarks_test.py::test_add_pytree` | `12358.153554517876` iter/sec (`stddev: 0.00011198467990816379`) | `30554.01449889499` iter/sec (`stddev: 0.000003242521013973305`) | `2.47` | | `benchmarks/common/pytree_benchmarks_test.py::test_add_td` | `8460.561779317395` iter/sec (`stddev: 0.0001071044659562639`) | `17428.648656598485` iter/sec (`stddev: 0.0000033848856519431052`) | `2.06` | | `benchmarks/nn/functional_benchmarks_test.py::test_exec_functo
GPU Pytest benchmark (linux.4xlarge.nvidia.gpu, 3.8)
Process completed with exit code 2.
CPU Pytest benchmark
Performance alert! Previous value was 7102.635672018859 and current value is 3419.7137298629254. It is 2.0769679081598325x worse than previous exceeding a ratio threshold 2
CPU Pytest benchmark
Performance alert! Previous value was 1331.741397657034 and current value is 656.343150461759. It is 2.029032216943393x worse than previous exceeding a ratio threshold 2
CPU Pytest benchmark
Performance alert! Previous value was 1626.0407392109466 and current value is 788.6443206913364. It is 2.0618175983129343x worse than previous exceeding a ratio threshold 2
CPU Pytest benchmark
Performance alert! Previous value was 2064.2310412001884 and current value is 955.063108522064. It is 2.161355645277236x worse than previous exceeding a ratio threshold 2
CPU Pytest benchmark
Performance alert! Previous value was 37081.704008478664 and current value is 17219.6549339233. It is 2.1534522120664836x worse than previous exceeding a ratio threshold 2
CPU Pytest benchmark
Performance alert! Previous value was 19100.86607737998 and current value is 8719.754485117723. It is 2.1905279684170034x worse than previous exceeding a ratio threshold 2
CPU Pytest benchmark
Performance alert! Previous value was 24645.2337086472 and current value is 11436.732419311986. It is 2.15491915042372x worse than previous exceeding a ratio threshold 2
CPU Pytest benchmark
Performance alert! Previous value was 1670689.808577556 and current value is 644461.6098652725. It is 2.592380652319726x worse than previous exceeding a ratio threshold 2
CPU Pytest benchmark
Performance alert! Previous value was 3439.973939450101 and current value is 1504.858172785846. It is 2.2859123880637213x worse than previous exceeding a ratio threshold 2
CPU Pytest benchmark
Performance alert! Previous value was 3130.170212285269 and current value is 1422.4732601074566. It is 2.2005125158196712x worse than previous exceeding a ratio threshold 2