-
Notifications
You must be signed in to change notification settings - Fork 231
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
test(benchmark): add baby bear poseidon2 benchmark #519
Conversation
please add the scope benchmark to all the commits. |
109ae21
to
843f3f4
Compare
843f3f4
to
bfcd3e5
Compare
98facc0
to
e646b19
Compare
e646b19
to
940c74c
Compare
bcdf927
to
0be182b
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
0be182b
to
ccefa39
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
ccefa39
to
7843d32
Compare
7843d32
to
23b439b
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Note that Poseidon2 permutations are now run 100 times to make the difference in results more visible. Authored by @chokobole, fixed by @ashjeong
23b439b
to
67d1c51
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
[Optional] how about changing the names of the files?
from benchmark/poseidon2/poseidon2_benchmark_baby_bear_horizen_ubuntu_i9.png
to benchmark/poseidon2/baby_bear_horizen_ubuntu_i9.png
Else, LGTM
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
I do agree with you that this would be better shortened in the way you mentioned; however the photos are named in this way across all other benchmark photos and the standard becomes convoluted especially with the fft benchmark folder which has |
Whereas all other benchmarks display all vendors on the same graph, Plonky3 and Horizen compute values with a different internal matrix, requiring them to be compared with Tachyon separately.