-
Notifications
You must be signed in to change notification settings - Fork 799
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix(cmd bench-omni): build omni-bencher with production profile #7299
Conversation
Signed-off-by: Iulian Barbu <[email protected]>
Signed-off-by: Iulian Barbu <[email protected]>
/cmd bench --runtime westend --pallets pallet_balances |
Command "bench --runtime westend --pallets pallet_balances" has started 🚀 See logs here |
Command "bench --runtime westend --pallets pallet_balances" has finished ✅ See logs here |
/cmd bench --runtime westend --pallet pallet_balances |
Command "bench --runtime westend --pallet pallet_balances" has started 🚀 See logs here |
…llet pallet_balances'
Command "bench --runtime westend --pallet pallet_balances" has finished ✅ See logs here Subweight results:
Command output:✅ Successful benchmarks of runtimes/pallets: |
/cmd bench-omni --runtime westend --pallet pallet_balances |
Command "bench-omni --runtime westend --pallet pallet_balances" has started 🚀 See logs here |
… --pallet pallet_balances'
Command "bench-omni --runtime westend --pallet pallet_balances" has finished ✅ See logs here Subweight results:
Command output:✅ Successful benchmarks of runtimes/pallets: |
Signed-off-by: Iulian Barbu <[email protected]>
Signed-off-by: Iulian Barbu <[email protected]>
@iulianbarbu if I compare 2 commits b/w each other - i see that bench-omni is still 30% worse as it was before with threshold 2 it shows all of them degraded |
Looks like the commits are from paritytech/polkadot-sdk. Wouldn't the comparisons use the omni-bencher built w/o the prod profile, so the results make sense? In any case, seems like the commits refer to my previous attempts to reproduce your issue on this branch, on this repo, on this org, while my actual fixing/testing happened on paritytech-stg. Fixing master on paritytech is based on the results of the tests from paritytech-stg. |
@iulianbarbu you're right! I didn't think that it's a context of paritytech and this change is still pulling from master |
Description
This PR builds frame-omni-bencher with
production
profile when calling/cmd bench-omni
to compute benchmarks for pallets.Fix proposed by @bkchr , thanks!
Closes #6797.
Integration
N/A
Review Notes
More info on #6797, and related to how the fix was tested: #6797 (comment).