Skip to content

Commit

Permalink
docs(benchmark): update Poseidon2 benchmark
Browse files Browse the repository at this point in the history
  • Loading branch information
@ashjeong
ashjeong committed Sep 10, 2024
1 parent 23a962d commit 4e92ef2
Show file tree
Hide file tree
Showing 7 changed files with 66 additions and 66 deletions.
132 changes: 66 additions & 66 deletions benchmark/poseidon2/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -27,35 +27,35 @@ bazel run -c opt --//:has_openmp --//:has_rtti --//:has_matplotlib //benchmark/p

| Trial Number | Tachyon | Horizen | Plonky3 |
| :----------- | -------- | ------------ | -------- |
| 0 | 0.06417 | **0.049875** | 0.082714 |
| 1 | 0.061176 | **0.049937** | 0.082634 |
| 2 | 0.060154 | **0.04997** | 0.082722 |
| 3 | 0.060016 | **0.049925** | 0.082925 |
| 4 | 0.060068 | **0.049902** | 0.082724 |
| 5 | 0.060079 | **0.052291** | 0.082722 |
| 6 | 0.060046 | **0.051501** | 0.08271 |
| 7 | 0.06008 | **0.049871** | 0.082694 |
| 8 | 0.06005 | **0.049768** | 0.082677 |
| 9 | 0.060036 | **0.049995** | 0.083914 |
| avg | 0.060587 | **0.050303** | 0.082843 |
| 0 | 0.064726 | **0.050047** | 0.082464 |
| 1 | 0.061723 | **0.049997** | 0.082598 |
| 2 | 0.060917 | **0.050063** | 0.08257 |
| 3 | 0.06086 | **0.049952** | 0.082493 |
| 4 | 0.060655 | **0.050173** | 0.082409 |
| 5 | 0.060768 | **0.050683** | 0.08268 |
| 6 | 0.060843 | **0.050278** | 0.082675 |
| 7 | 0.060696 | **0.050062** | 0.082579 |
| 8 | 0.060688 | **0.05004** | 0.082592 |
| 9 | 0.060677 | **0.050128** | 0.083144 |
| avg | 0.061255 | **0.050142** | 0.08262 |

![image](/benchmark/poseidon2/poseidon2_benchmark_bn254_ubuntu_i9.png)

### On Mac M3 Pro

| Trial Number | Tachyon | Horizen | Plonky3 |
| :----------- | -------- | ------------ | -------- |
| 0 | 0.073586 | **0.055299** | 0.082223 |
| 1 | 0.073077 | **0.055153** | 0.082353 |
| 2 | 0.072825 | **0.055762** | 0.082113 |
| 3 | 0.072752 | **0.054881** | 0.082102 |
| 4 | 0.072827 | **0.055061** | 0.082143 |
| 5 | 0.072827 | **0.054988** | 0.082222 |
| 6 | 0.072862 | **0.05494** | 0.082222 |
| 7 | 0.072745 | **0.055217** | 0.082189 |
| 8 | 0.0729 | **0.054908** | 0.082151 |
| 9 | 0.072922 | **0.055135** | 0.082084 |
| avg | 0.072932 | **0.055134** | 0.08218 |
| 0 | 0.072979 | **0.055031** | 0.081624 |
| 1 | 0.072478 | **0.054731** | 0.081525 |
| 2 | 0.071973 | **0.055768** | 0.081633 |
| 3 | 0.071969 | **0.054835** | 0.081638 |
| 4 | 0.072009 | **0.054884** | 0.081545 |
| 5 | 0.071933 | **0.055** | 0.081572 |
| 6 | 0.07201 | **0.054946** | 0.081521 |
| 7 | 0.072033 | **0.054883** | 0.081539 |
| 8 | 0.071967 | **0.054989** | 0.081626 |
| 9 | 0.071934 | **0.054942** | 0.081556 |
| avg | 0.072128 | **0.055** | 0.081577 |

![image](/benchmark/poseidon2/poseidon2_benchmark_bn254_mac_m3.png)

Expand All @@ -73,35 +73,35 @@ bazel run -c opt --//:has_openmp --//:has_rtti --//:has_matplotlib //benchmark/p

| Trial Number | Tachyon | Horizen |
| :----------- | ------------ | -------- |
| 0 | **0.012201** | 0.036443 |
| 1 | **0.012022** | 0.035775 |
| 2 | **0.011884** | 0.034381 |
| 3 | **0.011955** | 0.034372 |
| 4 | **0.011902** | 0.034503 |
| 5 | **0.011901** | 0.034408 |
| 6 | **0.011873** | 0.034462 |
| 7 | **0.011807** | 0.034393 |
| 8 | **0.011835** | 0.034304 |
| 9 | **0.011794** | 0.034446 |
| avg | **0.011917** | 0.034748 |
| 0 | **0.011549** | 0.034751 |
| 1 | **0.011439** | 0.034627 |
| 2 | **0.011475** | 0.034581 |
| 3 | **0.011543** | 0.035442 |
| 4 | **0.011455** | 0.03632 |
| 5 | **0.011372** | 0.034545 |
| 6 | **0.011381** | 0.034538 |
| 7 | **0.011142** | 0.03459 |
| 8 | **0.010845** | 0.034522 |
| 9 | **0.010819** | 0.034589 |
| avg | **0.011302** | 0.03485 |

![image](/benchmark/poseidon2/poseidon2_benchmark_baby_bear_horizen_ubuntu_i9.png)

#### On Mac M3 Pro

| Trial Number | Tachyon | Horizen |
| :----------- | ------------ | -------- |
| 0 | **0.011549** | 0.013957 |
| 1 | **0.01148** | 0.014097 |
| 2 | **0.011512** | 0.01411 |
| 3 | **0.011383** | 0.013999 |
| 4 | **0.011461** | 0.014056 |
| 5 | **0.011371** | 0.014166 |
| 6 | **0.011386** | 0.014089 |
| 7 | **0.011587** | 0.014151 |
| 8 | **0.01141** | 0.014135 |
| 9 | **0.011608** | 0.01411 |
| avg | **0.011474** | 0.014087 |
| 0 | **0.010979** | 0.013892 |
| 1 | **0.010574** | 0.013858 |
| 2 | **0.010544** | 0.014098 |
| 3 | **0.010642** | 0.013843 |
| 4 | **0.010517** | 0.013842 |
| 5 | **0.010599** | 0.013938 |
| 6 | **0.010519** | 0.013913 |
| 7 | **0.010474** | 0.013889 |
| 8 | **0.010572** | 0.013892 |
| 9 | **0.010533** | 0.013979 |
| avg | **0.010595** | 0.013914 |

![image](/benchmark/poseidon2/poseidon2_benchmark_baby_bear_horizen_mac_m3.png)

Expand All @@ -115,34 +115,34 @@ bazel run -c opt --//:has_openmp --//:has_rtti --//:has_matplotlib //benchmark/p

| Trial Number | Tachyon | Plonky3 |
| :----------- | -------- | ------------ |
| 0 | 0.010727 | **0.006418** |
| 1 | 0.01039 | **0.006261** |
| 2 | 0.010394 | **0.006259** |
| 3 | 0.010416 | **0.006262** |
| 4 | 0.010356 | **0.006226** |
| 5 | 0.010302 | **0.006227** |
| 6 | 0.010302 | **0.006235** |
| 7 | 0.010301 | **0.006424** |
| 8 | 0.010116 | **0.006304** |
| 9 | 0.009905 | **0.006233** |
| avg | 0.01032 | **0.006284** |
| 0 | 0.009848 | **0.006655** |
| 1 | 0.00992 | **0.006582** |
| 2 | 0.009955 | **0.006616** |
| 3 | 0.009811 | **0.006572** |
| 4 | 0.009851 | **0.006537** |
| 5 | 0.009776 | **0.006645** |
| 6 | 0.009822 | **0.006548** |
| 7 | 0.009738 | **0.006586** |
| 8 | 0.009757 | **0.006594** |
| 9 | 0.009717 | **0.006619** |
| avg | 0.009819 | **0.006595** |

![image](/benchmark/poseidon2/poseidon2_benchmark_baby_bear_plonky3_ubuntu_i9.png)

#### On Mac M3 Pro

| Trial Number | Tachyon | Plonky3 |
| :----------- | -------- | ------------ |
| 0 | 0.009962 | **0.007355** |
| 1 | 0.009939 | **0.007373** |
| 2 | 0.009851 | **0.007431** |
| 3 | 0.009943 | **0.007453** |
| 4 | 0.009853 | **0.007399** |
| 5 | 0.009826 | **0.007459** |
| 6 | 0.009825 | **0.007385** |
| 7 | 0.009884 | **0.007389** |
| 8 | 0.009819 | **0.007403** |
| 9 | 0.009937 | **0.007353** |
| avg | 0.009883 | **0.0074** |
| 0 | 0.009201 | **0.00732** |
| 1 | 0.008927 | **0.007346** |
| 2 | 0.008922 | **0.007309** |
| 3 | 0.008735 | **0.007324** |
| 4 | 0.008765 | **0.0076** |
| 5 | 0.008715 | **0.007335** |
| 6 | 0.008704 | **0.007439** |
| 7 | 0.008664 | **0.007369** |
| 8 | 0.008679 | **0.007347** |
| 9 | 0.008657 | **0.007353** |
| avg | 0.008796 | **0.007374** |

![image](/benchmark/poseidon2/poseidon2_benchmark_baby_bear_plonky3_mac_m3.png)\*\*\*\*
Binary file modified benchmark/poseidon2/poseidon2_benchmark_baby_bear_horizen_mac_m3.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified benchmark/poseidon2/poseidon2_benchmark_baby_bear_horizen_ubuntu_i9.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified benchmark/poseidon2/poseidon2_benchmark_baby_bear_plonky3_mac_m3.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified benchmark/poseidon2/poseidon2_benchmark_baby_bear_plonky3_ubuntu_i9.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified benchmark/poseidon2/poseidon2_benchmark_bn254_mac_m3.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified benchmark/poseidon2/poseidon2_benchmark_bn254_ubuntu_i9.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 4e92ef2

Please sign in to comment.