Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Versioning] Housekeeping in setup.py #1816

Merged
merged 1 commit into from
Jan 19, 2024
Merged

[Versioning] Housekeeping in setup.py #1816

merged 1 commit into from
Jan 19, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Jan 19, 2024 •
edited
Loading

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Jan 19, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/1816

Note: Links to docs will display an error until the docs builds have been completed.

⏳ 1 Pending, 9 Unrelated Failures

As of commit 229bc31 with merge base 2ecb709 (image):

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 19, 2024
@vmoens vmoens added the versioning Versioning change (version number etc) label Jan 19, 2024
@vmoens vmoens merged commit 57139bd into main Jan 19, 2024
53 of 62 checks passed
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 89. Improved: $\large\color{#35bf28}6$. Worsened: $\large\color{#d91a1a}2$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1413s 64.3564ms 15.5385 Ops/s 16.0500 Ops/s $\color{#d91a1a}-3.19\%$
test_sync 34.4658ms 33.1082ms 30.2040 Ops/s 29.9906 Ops/s $\color{#35bf28}+0.71\%$
test_async 0.1124s 32.5710ms 30.7021 Ops/s 31.3197 Ops/s $\color{#d91a1a}-1.97\%$
test_simple 0.4847s 0.4257s 2.3489 Ops/s 2.2704 Ops/s $\color{#35bf28}+3.46\%$
test_transformed 0.6333s 0.5781s 1.7297 Ops/s 1.6640 Ops/s $\color{#35bf28}+3.95\%$
test_serial 1.3714s 1.3198s 0.7577 Ops/s 0.7221 Ops/s $\color{#35bf28}+4.94\%$
test_parallel 1.2438s 1.1898s 0.8405 Ops/s 0.8374 Ops/s $\color{#35bf28}+0.37\%$
test_step_mdp_speed[True-True-True-True-True] 0.1306ms 21.0909μs 47.4138 KOps/s 48.0020 KOps/s $\color{#d91a1a}-1.23\%$
test_step_mdp_speed[True-True-True-True-False] 47.5180μs 13.0164μs 76.8263 KOps/s 77.8326 KOps/s $\color{#d91a1a}-1.29\%$
test_step_mdp_speed[True-True-True-False-True] 40.9360μs 12.4746μs 80.1631 KOps/s 81.5016 KOps/s $\color{#d91a1a}-1.64\%$
test_step_mdp_speed[True-True-True-False-False] 41.3880μs 7.5697μs 132.1054 KOps/s 131.4435 KOps/s $\color{#35bf28}+0.50\%$
test_step_mdp_speed[True-True-False-True-True] 47.6790μs 22.8488μs 43.7660 KOps/s 44.6772 KOps/s $\color{#d91a1a}-2.04\%$
test_step_mdp_speed[True-True-False-True-False] 52.6890μs 14.4015μs 69.4371 KOps/s 70.4681 KOps/s $\color{#d91a1a}-1.46\%$
test_step_mdp_speed[True-True-False-False-True] 47.7090μs 13.6879μs 73.0572 KOps/s 74.0351 KOps/s $\color{#d91a1a}-1.32\%$
test_step_mdp_speed[True-True-False-False-False] 26.6600μs 8.8293μs 113.2592 KOps/s 113.4991 KOps/s $\color{#d91a1a}-0.21\%$
test_step_mdp_speed[True-False-True-True-True] 67.5160μs 23.9015μs 41.8384 KOps/s 42.0056 KOps/s $\color{#d91a1a}-0.40\%$
test_step_mdp_speed[True-False-True-True-False] 44.0020μs 15.4569μs 64.6962 KOps/s 64.4773 KOps/s $\color{#35bf28}+0.34\%$
test_step_mdp_speed[True-False-True-False-True] 46.4570μs 13.8052μs 72.4364 KOps/s 74.0781 KOps/s $\color{#d91a1a}-2.22\%$
test_step_mdp_speed[True-False-True-False-False] 45.1050μs 8.7336μs 114.4999 KOps/s 114.6266 KOps/s $\color{#d91a1a}-0.11\%$
test_step_mdp_speed[True-False-False-True-True] 56.0850μs 25.2338μs 39.6294 KOps/s 40.5301 KOps/s $\color{#d91a1a}-2.22\%$
test_step_mdp_speed[True-False-False-True-False] 50.8050μs 16.8652μs 59.2937 KOps/s 60.6634 KOps/s $\color{#d91a1a}-2.26\%$
test_step_mdp_speed[True-False-False-False-True] 39.9850μs 14.8041μs 67.5491 KOps/s 68.4339 KOps/s $\color{#d91a1a}-1.29\%$
test_step_mdp_speed[True-False-False-False-False] 41.1460μs 10.1057μs 98.9540 KOps/s 102.0725 KOps/s $\color{#d91a1a}-3.06\%$
test_step_mdp_speed[False-True-True-True-True] 52.5080μs 24.1979μs 41.3260 KOps/s 42.0042 KOps/s $\color{#d91a1a}-1.61\%$
test_step_mdp_speed[False-True-True-True-False] 50.2040μs 15.8909μs 62.9290 KOps/s 65.0447 KOps/s $\color{#d91a1a}-3.25\%$
test_step_mdp_speed[False-True-True-False-True] 43.9120μs 15.8719μs 63.0045 KOps/s 62.9353 KOps/s $\color{#35bf28}+0.11\%$
test_step_mdp_speed[False-True-True-False-False] 40.6460μs 9.8362μs 101.6655 KOps/s 100.6174 KOps/s $\color{#35bf28}+1.04\%$
test_step_mdp_speed[False-True-False-True-True] 63.2880μs 25.0952μs 39.8482 KOps/s 40.1358 KOps/s $\color{#d91a1a}-0.72\%$
test_step_mdp_speed[False-True-False-True-False] 52.0170μs 16.9140μs 59.1226 KOps/s 60.3072 KOps/s $\color{#d91a1a}-1.96\%$
test_step_mdp_speed[False-True-False-False-True] 37.4500μs 16.8967μs 59.1831 KOps/s 59.1079 KOps/s $\color{#35bf28}+0.13\%$
test_step_mdp_speed[False-True-False-False-False] 36.6180μs 11.0541μs 90.4639 KOps/s 90.5122 KOps/s $\color{#d91a1a}-0.05\%$
test_step_mdp_speed[False-False-True-True-True] 59.7820μs 26.5278μs 37.6963 KOps/s 38.0457 KOps/s $\color{#d91a1a}-0.92\%$
test_step_mdp_speed[False-False-True-True-False] 51.0060μs 17.9995μs 55.5571 KOps/s 55.7400 KOps/s $\color{#d91a1a}-0.33\%$
test_step_mdp_speed[False-False-True-False-True] 54.6620μs 16.8545μs 59.3313 KOps/s 58.6403 KOps/s $\color{#35bf28}+1.18\%$
test_step_mdp_speed[False-False-True-False-False] 43.0110μs 11.1315μs 89.8355 KOps/s 89.9471 KOps/s $\color{#d91a1a}-0.12\%$
test_step_mdp_speed[False-False-False-True-True] 67.4960μs 27.1724μs 36.8020 KOps/s 37.0337 KOps/s $\color{#d91a1a}-0.63\%$
test_step_mdp_speed[False-False-False-True-False] 65.0720μs 19.0413μs 52.5173 KOps/s 52.6977 KOps/s $\color{#d91a1a}-0.34\%$
test_step_mdp_speed[False-False-False-False-True] 55.2830μs 17.8438μs 56.0418 KOps/s 56.0844 KOps/s $\color{#d91a1a}-0.08\%$
test_step_mdp_speed[False-False-False-False-False] 33.0510μs 12.0816μs 82.7703 KOps/s 81.4666 KOps/s $\color{#35bf28}+1.60\%$
test_values[generalized_advantage_estimate-True-True] 14.5947ms 12.0765ms 82.8054 Ops/s 82.8929 Ops/s $\color{#d91a1a}-0.11\%$
test_values[vec_generalized_advantage_estimate-True-True] 29.0530ms 27.8593ms 35.8946 Ops/s 35.5349 Ops/s $\color{#35bf28}+1.01\%$
test_values[td0_return_estimate-False-False] 0.2479ms 0.1771ms 5.6454 KOps/s 5.6854 KOps/s $\color{#d91a1a}-0.70\%$
test_values[td1_return_estimate-False-False] 25.6563ms 25.1937ms 39.6925 Ops/s 39.1042 Ops/s $\color{#35bf28}+1.50\%$
test_values[vec_td1_return_estimate-False-False] 36.9967ms 28.2624ms 35.3827 Ops/s 35.4183 Ops/s $\color{#d91a1a}-0.10\%$
test_values[td_lambda_return_estimate-True-False] 36.8516ms 35.3977ms 28.2504 Ops/s 27.6621 Ops/s $\color{#35bf28}+2.13\%$
test_values[vec_td_lambda_return_estimate-True-False] 35.1943ms 28.0973ms 35.5906 Ops/s 35.2580 Ops/s $\color{#35bf28}+0.94\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.1393ms 8.0221ms 124.6559 Ops/s 123.0047 Ops/s $\color{#35bf28}+1.34\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 10.7547ms 1.8944ms 527.8621 Ops/s 567.1512 Ops/s $\textbf{\color{#d91a1a}-6.93\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4999ms 0.4300ms 2.3255 KOps/s 2.2703 KOps/s $\color{#35bf28}+2.43\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 41.6299ms 33.3231ms 30.0092 Ops/s 25.5637 Ops/s $\textbf{\color{#35bf28}+17.39\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 11.1656ms 2.6447ms 378.1105 Ops/s 377.4516 Ops/s $\color{#35bf28}+0.17\%$
test_dqn_speed 87.5625ms 7.8066ms 128.0968 Ops/s 132.0874 Ops/s $\color{#d91a1a}-3.02\%$
test_ddpg_speed 16.9712ms 14.0055ms 71.4006 Ops/s 68.9327 Ops/s $\color{#35bf28}+3.58\%$
test_sac_speed 32.1941ms 28.2060ms 35.4535 Ops/s 34.0575 Ops/s $\color{#35bf28}+4.10\%$
test_redq_speed 51.7389ms 43.8408ms 22.8098 Ops/s 21.9451 Ops/s $\color{#35bf28}+3.94\%$
test_redq_deprec_speed 27.7459ms 24.6203ms 40.6168 Ops/s 39.1018 Ops/s $\color{#35bf28}+3.87\%$
test_td3_speed 29.1405ms 19.5849ms 51.0597 Ops/s 49.3656 Ops/s $\color{#35bf28}+3.43\%$
test_cql_speed 90.9250ms 84.8304ms 11.7882 Ops/s 11.2299 Ops/s $\color{#35bf28}+4.97\%$
test_a2c_speed 31.5345ms 25.8356ms 38.7062 Ops/s 37.7515 Ops/s $\color{#35bf28}+2.53\%$
test_ppo_speed 26.4605ms 25.8772ms 38.6440 Ops/s 36.5407 Ops/s $\textbf{\color{#35bf28}+5.76\%}$
test_reinforce_speed 33.7811ms 24.8568ms 40.2304 Ops/s 37.9257 Ops/s $\textbf{\color{#35bf28}+6.08\%}$
test_iql_speed 65.1951ms 61.1751ms 16.3465 Ops/s 15.4258 Ops/s $\textbf{\color{#35bf28}+5.97\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 1.8209ms 1.3585ms 736.1290 Ops/s 713.3264 Ops/s $\color{#35bf28}+3.20\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 9.2902ms 0.5174ms 1.9328 KOps/s 1.8957 KOps/s $\color{#35bf28}+1.96\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 8.6756ms 0.4917ms 2.0337 KOps/s 2.0197 KOps/s $\color{#35bf28}+0.69\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 1.4806ms 1.3329ms 750.2170 Ops/s 732.3444 Ops/s $\color{#35bf28}+2.44\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7215ms 0.5045ms 1.9824 KOps/s 1.9079 KOps/s $\color{#35bf28}+3.90\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 9.1176ms 0.4854ms 2.0603 KOps/s 2.0165 KOps/s $\color{#35bf28}+2.17\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.1744ms 1.5335ms 652.1159 Ops/s 603.8422 Ops/s $\textbf{\color{#35bf28}+7.99\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 9.0208ms 0.6512ms 1.5357 KOps/s 1.4954 KOps/s $\color{#35bf28}+2.70\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 8.8725ms 0.6237ms 1.6033 KOps/s 1.5608 KOps/s $\color{#35bf28}+2.72\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 1.7972ms 1.3519ms 739.6887 Ops/s 728.8009 Ops/s $\color{#35bf28}+1.49\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7583ms 0.5127ms 1.9503 KOps/s 1.9316 KOps/s $\color{#35bf28}+0.97\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 8.7964ms 0.4969ms 2.0125 KOps/s 2.0303 KOps/s $\color{#d91a1a}-0.88\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 1.4420ms 1.3228ms 755.9974 Ops/s 744.6127 Ops/s $\color{#35bf28}+1.53\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6267ms 0.5057ms 1.9773 KOps/s 1.9015 KOps/s $\color{#35bf28}+3.99\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6169ms 0.4794ms 2.0858 KOps/s 2.0474 KOps/s $\color{#35bf28}+1.87\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.2001ms 1.5258ms 655.3765 Ops/s 635.4390 Ops/s $\color{#35bf28}+3.14\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 9.0141ms 0.6526ms 1.5323 KOps/s 1.5049 KOps/s $\color{#35bf28}+1.82\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 8.8707ms 0.6240ms 1.6027 KOps/s 1.5952 KOps/s $\color{#35bf28}+0.47\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1082s 12.0273ms 83.1439 Ops/s 82.6177 Ops/s $\color{#35bf28}+0.64\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 19.6426ms 13.4906ms 74.1259 Ops/s 72.3536 Ops/s $\color{#35bf28}+2.45\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 5.3931ms 3.2044ms 312.0709 Ops/s 304.1899 Ops/s $\color{#35bf28}+2.59\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1011s 10.0132ms 99.8687 Ops/s 100.3599 Ops/s $\color{#d91a1a}-0.49\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 15.6874ms 13.4354ms 74.4300 Ops/s 63.8229 Ops/s $\textbf{\color{#35bf28}+16.62\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 6.2694ms 3.2531ms 307.4018 Ops/s 305.6522 Ops/s $\color{#35bf28}+0.57\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1007s 12.0594ms 82.9229 Ops/s 96.7494 Ops/s $\textbf{\color{#d91a1a}-14.29\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 21.4266ms 13.8014ms 72.4562 Ops/s 71.0445 Ops/s $\color{#35bf28}+1.99\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 6.4513ms 3.4542ms 289.5002 Ops/s 283.2812 Ops/s $\color{#35bf28}+2.20\%$

@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 92. Improved: $\large\color{#35bf28}5$. Worsened: $\large\color{#d91a1a}1$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1157s 0.1149s 8.7034 Ops/s 8.4872 Ops/s $\color{#35bf28}+2.55\%$
test_sync 0.1727s 0.1024s 9.7635 Ops/s 9.7018 Ops/s $\color{#35bf28}+0.64\%$
test_async 0.1816s 91.6636ms 10.9095 Ops/s 10.8836 Ops/s $\color{#35bf28}+0.24\%$
test_single_pixels 0.1394s 0.1393s 7.1770 Ops/s 7.0941 Ops/s $\color{#35bf28}+1.17\%$
test_sync_pixels 78.2705ms 76.4842ms 13.0746 Ops/s 12.8493 Ops/s $\color{#35bf28}+1.75\%$
test_async_pixels 0.2106s 72.6590ms 13.7629 Ops/s 13.9457 Ops/s $\color{#d91a1a}-1.31\%$
test_simple 0.9039s 0.8345s 1.1984 Ops/s 1.1650 Ops/s $\color{#35bf28}+2.87\%$
test_transformed 1.1348s 1.0726s 0.9323 Ops/s 0.9179 Ops/s $\color{#35bf28}+1.57\%$
test_serial 2.3691s 2.3008s 0.4346 Ops/s 0.4108 Ops/s $\textbf{\color{#35bf28}+5.79\%}$
test_parallel 1.9876s 1.8881s 0.5296 Ops/s 0.5317 Ops/s $\color{#d91a1a}-0.39\%$
test_step_mdp_speed[True-True-True-True-True] 99.3320μs 33.0196μs 30.2851 KOps/s 30.3124 KOps/s $\color{#d91a1a}-0.09\%$
test_step_mdp_speed[True-True-True-True-False] 44.5100μs 19.3600μs 51.6530 KOps/s 49.1986 KOps/s $\color{#35bf28}+4.99\%$
test_step_mdp_speed[True-True-True-False-True] 44.2210μs 18.6811μs 53.5300 KOps/s 53.1931 KOps/s $\color{#35bf28}+0.63\%$
test_step_mdp_speed[True-True-True-False-False] 39.6400μs 11.1176μs 89.9476 KOps/s 88.2728 KOps/s $\color{#35bf28}+1.90\%$
test_step_mdp_speed[True-True-False-True-True] 63.9810μs 34.7312μs 28.7926 KOps/s 28.4844 KOps/s $\color{#35bf28}+1.08\%$
test_step_mdp_speed[True-True-False-True-False] 44.2110μs 21.3407μs 46.8589 KOps/s 45.5863 KOps/s $\color{#35bf28}+2.79\%$
test_step_mdp_speed[True-True-False-False-True] 42.4800μs 20.7713μs 48.1434 KOps/s 48.0275 KOps/s $\color{#35bf28}+0.24\%$
test_step_mdp_speed[True-True-False-False-False] 30.4410μs 13.0092μs 76.8685 KOps/s 75.0336 KOps/s $\color{#35bf28}+2.45\%$
test_step_mdp_speed[True-False-True-True-True] 62.5410μs 36.8337μs 27.1490 KOps/s 26.7973 KOps/s $\color{#35bf28}+1.31\%$
test_step_mdp_speed[True-False-True-True-False] 40.7610μs 23.4286μs 42.6829 KOps/s 41.3262 KOps/s $\color{#35bf28}+3.28\%$
test_step_mdp_speed[True-False-True-False-True] 86.8920μs 20.6092μs 48.5219 KOps/s 47.9674 KOps/s $\color{#35bf28}+1.16\%$
test_step_mdp_speed[True-False-True-False-False] 37.2710μs 13.0520μs 76.6164 KOps/s 74.6251 KOps/s $\color{#35bf28}+2.67\%$
test_step_mdp_speed[True-False-False-True-True] 60.3900μs 38.6933μs 25.8443 KOps/s 25.5643 KOps/s $\color{#35bf28}+1.10\%$
test_step_mdp_speed[True-False-False-True-False] 47.6110μs 25.2740μs 39.5664 KOps/s 38.4267 KOps/s $\color{#35bf28}+2.97\%$
test_step_mdp_speed[True-False-False-False-True] 47.8200μs 22.4590μs 44.5255 KOps/s 44.0377 KOps/s $\color{#35bf28}+1.11\%$
test_step_mdp_speed[True-False-False-False-False] 47.0410μs 14.7897μs 67.6146 KOps/s 65.2675 KOps/s $\color{#35bf28}+3.60\%$
test_step_mdp_speed[False-True-True-True-True] 54.1700μs 36.8222μs 27.1575 KOps/s 26.8443 KOps/s $\color{#35bf28}+1.17\%$
test_step_mdp_speed[False-True-True-True-False] 49.4020μs 23.3747μs 42.7812 KOps/s 41.2643 KOps/s $\color{#35bf28}+3.68\%$
test_step_mdp_speed[False-True-True-False-True] 45.0210μs 24.1229μs 41.4544 KOps/s 39.9013 KOps/s $\color{#35bf28}+3.89\%$
test_step_mdp_speed[False-True-True-False-False] 39.7500μs 14.6708μs 68.1627 KOps/s 64.0093 KOps/s $\textbf{\color{#35bf28}+6.49\%}$
test_step_mdp_speed[False-True-False-True-True] 64.0110μs 38.4896μs 25.9810 KOps/s 25.3779 KOps/s $\color{#35bf28}+2.38\%$
test_step_mdp_speed[False-True-False-True-False] 57.8920μs 25.4714μs 39.2598 KOps/s 38.3721 KOps/s $\color{#35bf28}+2.31\%$
test_step_mdp_speed[False-True-False-False-True] 42.4100μs 26.3410μs 37.9636 KOps/s 37.2847 KOps/s $\color{#35bf28}+1.82\%$
test_step_mdp_speed[False-True-False-False-False] 37.6310μs 16.6599μs 60.0243 KOps/s 57.6232 KOps/s $\color{#35bf28}+4.17\%$
test_step_mdp_speed[False-False-True-True-True] 63.2300μs 40.2330μs 24.8552 KOps/s 23.9036 KOps/s $\color{#35bf28}+3.98\%$
test_step_mdp_speed[False-False-True-True-False] 57.9710μs 27.3101μs 36.6165 KOps/s 35.2437 KOps/s $\color{#35bf28}+3.90\%$
test_step_mdp_speed[False-False-True-False-True] 45.8610μs 26.2712μs 38.0645 KOps/s 37.0054 KOps/s $\color{#35bf28}+2.86\%$
test_step_mdp_speed[False-False-True-False-False] 41.4620μs 16.6027μs 60.2312 KOps/s 57.6558 KOps/s $\color{#35bf28}+4.47\%$
test_step_mdp_speed[False-False-False-True-True] 65.5620μs 41.8855μs 23.8746 KOps/s 23.2755 KOps/s $\color{#35bf28}+2.57\%$
test_step_mdp_speed[False-False-False-True-False] 57.8520μs 28.8435μs 34.6698 KOps/s 33.3620 KOps/s $\color{#35bf28}+3.92\%$
test_step_mdp_speed[False-False-False-False-True] 58.7820μs 27.5244μs 36.3314 KOps/s 35.6919 KOps/s $\color{#35bf28}+1.79\%$
test_step_mdp_speed[False-False-False-False-False] 36.3300μs 18.4448μs 54.2159 KOps/s 52.3087 KOps/s $\color{#35bf28}+3.65\%$
test_values[generalized_advantage_estimate-True-True] 26.7692ms 25.9581ms 38.5236 Ops/s 38.7480 Ops/s $\color{#d91a1a}-0.58\%$
test_values[vec_generalized_advantage_estimate-True-True] 91.3880ms 3.3976ms 294.3249 Ops/s 291.4655 Ops/s $\color{#35bf28}+0.98\%$
test_values[td0_return_estimate-False-False] 95.9020μs 62.6142μs 15.9708 KOps/s 15.8340 KOps/s $\color{#35bf28}+0.86\%$
test_values[td1_return_estimate-False-False] 57.2036ms 56.7249ms 17.6289 Ops/s 18.3633 Ops/s $\color{#d91a1a}-4.00\%$
test_values[vec_td1_return_estimate-False-False] 2.1336ms 1.7753ms 563.2917 Ops/s 563.1955 Ops/s $\color{#35bf28}+0.02\%$
test_values[td_lambda_return_estimate-True-False] 91.5334ms 90.7905ms 11.0144 Ops/s 11.4821 Ops/s $\color{#d91a1a}-4.07\%$
test_values[vec_td_lambda_return_estimate-True-False] 2.1099ms 1.7736ms 563.8377 Ops/s 564.6426 Ops/s $\color{#d91a1a}-0.14\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 25.7980ms 25.2898ms 39.5417 Ops/s 41.3784 Ops/s $\color{#d91a1a}-4.44\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8537ms 0.7069ms 1.4146 KOps/s 1.4054 KOps/s $\color{#35bf28}+0.65\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7236ms 0.6615ms 1.5117 KOps/s 1.4856 KOps/s $\color{#35bf28}+1.75\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5082ms 1.4613ms 684.3029 Ops/s 682.5761 Ops/s $\color{#35bf28}+0.25\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9401ms 0.6818ms 1.4668 KOps/s 1.4561 KOps/s $\color{#35bf28}+0.73\%$
test_dqn_speed 7.4685ms 7.1598ms 139.6682 Ops/s 122.3056 Ops/s $\textbf{\color{#35bf28}+14.20\%}$
test_ddpg_speed 14.8826ms 14.1285ms 70.7790 Ops/s 68.8864 Ops/s $\color{#35bf28}+2.75\%$
test_sac_speed 29.2685ms 28.4037ms 35.2067 Ops/s 33.9884 Ops/s $\color{#35bf28}+3.58\%$
test_redq_speed 47.7185ms 46.3416ms 21.5789 Ops/s 20.8760 Ops/s $\color{#35bf28}+3.37\%$
test_redq_deprec_speed 24.4431ms 23.5405ms 42.4799 Ops/s 41.2522 Ops/s $\color{#35bf28}+2.98\%$
test_td3_speed 29.0482ms 19.3969ms 51.5546 Ops/s 49.8101 Ops/s $\color{#35bf28}+3.50\%$
test_cql_speed 82.7539ms 81.6318ms 12.2501 Ops/s 12.0058 Ops/s $\color{#35bf28}+2.03\%$
test_a2c_speed 26.8185ms 25.9986ms 38.4637 Ops/s 37.5799 Ops/s $\color{#35bf28}+2.35\%$
test_ppo_speed 27.6803ms 26.3591ms 37.9375 Ops/s 36.9792 Ops/s $\color{#35bf28}+2.59\%$
test_reinforce_speed 26.5811ms 25.1181ms 39.8120 Ops/s 38.6198 Ops/s $\color{#35bf28}+3.09\%$
test_iql_speed 56.7409ms 56.2398ms 17.7810 Ops/s 17.3692 Ops/s $\color{#35bf28}+2.37\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.5096ms 1.8086ms 552.9242 Ops/s 545.0417 Ops/s $\color{#35bf28}+1.45\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9558ms 0.8409ms 1.1892 KOps/s 1.1786 KOps/s $\color{#35bf28}+0.89\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 1.0322ms 0.8175ms 1.2233 KOps/s 1.2156 KOps/s $\color{#35bf28}+0.64\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.4838ms 1.7616ms 567.6499 Ops/s 549.4316 Ops/s $\color{#35bf28}+3.32\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.0329ms 0.8281ms 1.2077 KOps/s 1.1969 KOps/s $\color{#35bf28}+0.90\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 1.0065ms 0.8059ms 1.2409 KOps/s 1.2301 KOps/s $\color{#35bf28}+0.88\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.9997ms 2.0321ms 492.0945 Ops/s 483.9151 Ops/s $\color{#35bf28}+1.69\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.1629ms 0.9536ms 1.0487 KOps/s 1.0350 KOps/s $\color{#35bf28}+1.32\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.0574ms 0.9323ms 1.0727 KOps/s 1.0597 KOps/s $\color{#35bf28}+1.23\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.6352ms 1.8215ms 548.9874 Ops/s 473.2519 Ops/s $\textbf{\color{#35bf28}+16.00\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9808ms 0.8413ms 1.1887 KOps/s 1.1797 KOps/s $\color{#35bf28}+0.76\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.9484ms 0.8183ms 1.2220 KOps/s 1.2137 KOps/s $\color{#35bf28}+0.69\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 1.9311ms 1.7724ms 564.2198 Ops/s 553.5733 Ops/s $\color{#35bf28}+1.92\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.0591ms 0.8305ms 1.2041 KOps/s 1.1955 KOps/s $\color{#35bf28}+0.72\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 1.0179ms 0.8086ms 1.2367 KOps/s 1.2312 KOps/s $\color{#35bf28}+0.45\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.9243ms 2.0481ms 488.2544 Ops/s 481.4326 Ops/s $\color{#35bf28}+1.42\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.1882ms 0.9561ms 1.0460 KOps/s 897.9026 Ops/s $\textbf{\color{#35bf28}+16.49\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.0467ms 0.9359ms 1.0685 KOps/s 1.0590 KOps/s $\color{#35bf28}+0.89\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1437s 10.5708ms 94.6004 Ops/s 100.2199 Ops/s $\textbf{\color{#d91a1a}-5.61\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 16.3720ms 13.9246ms 71.8153 Ops/s 70.3631 Ops/s $\color{#35bf28}+2.06\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 5.7500ms 3.4008ms 294.0452 Ops/s 291.9607 Ops/s $\color{#35bf28}+0.71\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1189s 9.9458ms 100.5445 Ops/s 99.2805 Ops/s $\color{#35bf28}+1.27\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 16.1982ms 13.8452ms 72.2273 Ops/s 70.3308 Ops/s $\color{#35bf28}+2.70\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 6.2010ms 3.4118ms 293.1004 Ops/s 291.1012 Ops/s $\color{#35bf28}+0.69\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1166s 12.3416ms 81.0268 Ops/s 80.5440 Ops/s $\color{#35bf28}+0.60\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 16.3845ms 14.0564ms 71.1419 Ops/s 69.3771 Ops/s $\color{#35bf28}+2.54\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 6.6827ms 3.6067ms 277.2607 Ops/s 274.6029 Ops/s $\color{#35bf28}+0.97\%$

@vmoens vmoens deleted the exclude_from_setup branch February 27, 2024 00:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. versioning Versioning change (version number etc)
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot