Skip to content

[Versioning] M1 compatibility (#523) #311

[Versioning] M1 compatibility (#523)

[Versioning] M1 compatibility (#523) #311

Triggered via push October 26, 2023 20:40
Status Failure
Total duration 7m 49s
Artifacts

benchmarks.yml

on: push
CPU Pytest benchmark
7m 40s
CPU Pytest benchmark
Matrix: GPU Pytest benchmark
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 7 warnings
GPU Pytest benchmark (linux.4xlarge.nvidia.gpu, 3.8)
Process completed with exit code 2.
CPU Pytest benchmark
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'CPU Benchmark Results'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`. | Benchmark suite | Current: e2de5ef915bbfb30287e7ec74f44f4053db357c5 | Previous: 6a9f8e354848455054a74f61e74187bb0368677a | Ratio | |-|-|-|-| | `benchmarks/common/common_ops_test.py::test_getitem[range]` | `5907.631296135694` iter/sec (`stddev: 0.00011313076283935396`) | `12273.399836637294` iter/sec (`stddev: 0.0000024274520622255505`) | `2.08` | | `benchmarks/common/common_ops_test.py::test_getitem[list]` | `6454.485601943946` iter/sec (`stddev: 0.00009993011056679118`) | `13026.398437738166` iter/sec (`stddev: 0.00000427788044603234`) | `2.02` | | `benchmarks/common/common_ops_test.py::test_setitem_dim[slice_int]` | `7611.917760491742` iter/sec (`stddev: 0.0003105281474132736`) | `16189.485625140715` iter/sec (`stddev: 0.0000026220719954638607`) | `2.13` | | `benchmarks/common/memmap_benchmarks_test.py::test_add_one[memmap_tensor0]` | `14050.784320083547` iter/sec (`stddev: 0.00004814404506843958`) | `29702.995992213757` iter/sec (`stddev: 0.000026074768256202254`) | `2.11` | | `benchmarks/common/memmap_benchmarks_test.py::test_stack[memmap_tensor0]` | `16914.406636840806` iter/sec (`stddev: 0.00006893482736684527`) | `37002.6255684846` iter/sec (`stddev: 0.0000014862119865061807`) | `2.19` | | `benchmarks/common/memmap_benchmarks_test.py::test_memmaptd_index_op` | `184.0784972027477` iter/sec (`stddev: 0.0007522187030068204`) | `375.5558718082069` iter/sec (`stddev: 0.000019091399628856324`) | `2.04` | | `benchmarks/nn/functional_benchmarks_test.py::test_exec_td` | `2510.468163777016` iter/sec (`stddev: 0.0002610622473328803`) | `5214.390352153065` iter/sec (`stddev: 0.000006677945799307712`) | `2.08` | This comment was automatically generated by [workflow](https://github.com/pytorch/tensordict/actions?query=workflow%3AContinuous%20Benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @vmoens Comment was generated at https://github.com/pytorch/tensordict/commit/e2de5ef915bbfb30287e7ec74f44f4053db357c5#commitcomment-131019982
CPU Pytest benchmark
Performance alert! Previous value was 12273.399836637294 and current value is 5907.631296135694. It is 2.0775500740314623x worse than previous exceeding a ratio threshold 2
CPU Pytest benchmark
Performance alert! Previous value was 13026.398437738166 and current value is 6454.485601943946. It is 2.0181931204269645x worse than previous exceeding a ratio threshold 2
CPU Pytest benchmark
Performance alert! Previous value was 16189.485625140715 and current value is 7611.917760491742. It is 2.12686029126185x worse than previous exceeding a ratio threshold 2
CPU Pytest benchmark
Performance alert! Previous value was 29702.995992213757 and current value is 14050.784320083547. It is 2.113974232011921x worse than previous exceeding a ratio threshold 2
CPU Pytest benchmark
Performance alert! Previous value was 37002.6255684846 and current value is 16914.406636840806. It is 2.1876395881301676x worse than previous exceeding a ratio threshold 2
CPU Pytest benchmark
Performance alert! Previous value was 375.5558718082069 and current value is 184.0784972027477. It is 2.0401941427985597x worse than previous exceeding a ratio threshold 2
CPU Pytest benchmark
Performance alert! Previous value was 5214.390352153065 and current value is 2510.468163777016. It is 2.0770589435828497x worse than previous exceeding a ratio threshold 2