Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[no-release-notes] redo how to set tpc-c testing statistics #7806

Merged
merged 6 commits into from
May 3, 2024

Conversation

max-hoffman
Copy link
Contributor

No description provided.

@max-hoffman
Copy link
Contributor Author

#benchmark

Copy link

github-actions bot commented May 1, 2024

@coffeegoddd
Copy link
Contributor

@max-hoffman DOLT

comparing_percentages
100.000000 to 100.000000
version result total
099567b ok 5937457
version total_tests
099567b 5937457
correctness_percentage
100.0

@coffeegoddd
Copy link
Contributor

@max-hoffman DOLT

test_name from_latency_median to_latency_median is_faster
tpcc-scale-factor-1 99.33 97.55 0
test_name server_name server_version tps test_name server_name server_version tps is_faster
tpcc-scale-factor-1 dolt deed557 15.14 tpcc-scale-factor-1 dolt 099567b 6.52 1

@coffeegoddd
Copy link
Contributor

@coffeegoddd DOLT

comparing_percentages
100.000000 to 100.000000
version result total
8687ff9 ok 5937457
version total_tests
8687ff9 5937457
correctness_percentage
100.0

@coffeegoddd
Copy link
Contributor

@max-hoffman DOLT

comparing_percentages
100.000000 to 100.000000
version result total
4dedd1e ok 5937457
version total_tests
4dedd1e 5937457
correctness_percentage
100.0

@coffeegoddd
Copy link
Contributor

@max-hoffman DOLT

read_tests from_latency_median to_latency_median is_faster
covering_index_scan 3.13 3.07 0
groupby_scan 17.63 17.63 0
index_join 5.18 5.18 0
index_join_scan 2.22 2.22 0
index_scan 53.85 53.85 0
oltp_point_select 0.51 0.51 0
oltp_read_only 8.43 8.43 0
select_random_points 0.8 0.8 0
select_random_ranges 0.97 0.97 0
table_scan 54.83 54.83 0
types_table_scan 134.9 134.9 0
write_tests from_latency_median to_latency_median is_faster
oltp_delete_insert 6.91 6.91 0
oltp_insert 3.43 3.43 0
oltp_read_write 16.12 16.12 0
oltp_update_index 3.49 3.49 0
oltp_update_non_index 3.43 3.43 0
oltp_write_only 7.84 7.98 0
types_delete_insert 7.56 7.56 0

@coffeegoddd
Copy link
Contributor

@max-hoffman DOLT

comparing_percentages
100.000000 to 100.000000
version result total
6afaa09 ok 5937457
version total_tests
6afaa09 5937457
correctness_percentage
100.0

@coffeegoddd
Copy link
Contributor

@max-hoffman DOLT

comparing_percentages
100.000000 to 100.000000
version result total
ce68ea9 ok 5937457
version total_tests
ce68ea9 5937457
correctness_percentage
100.0

@max-hoffman max-hoffman merged commit 34c3613 into main May 3, 2024
21 of 22 checks passed
@max-hoffman max-hoffman deleted the max/tpcc-stats-redo branch May 3, 2024 20:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants