Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix benchmark report for comparison #654

Merged
merged 3 commits into from
Jul 9, 2024
Merged

Conversation

afsalthaj
Copy link
Contributor

No description provided.


pub(crate) fn display_optional_duration(duration: Option<Duration>) -> String {
duration.map_or("Unavailable".to_string(), |duration| {
format!("{:?}", duration)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unavailable shouldn't be in debug mode as it escapes string quotes, and that's the fix.
Before this, unavailable was printed as \"unavailable\" which conflicted within a json text

@afsalthaj
Copy link
Contributor Author

/run-benchmark-refresh

Copy link

github-actions bot commented Jul 8, 2024

Benchmark Report

benchmark_cold_start_large.json

Result Key Cluster Size Size Length Avg Time
invocation 1 500 10 1.127268187s
invocation 1 250 10 637.302847ms
invocation 1 100 10 320.741649ms

benchmark_cold_start_large_no_compilation.json

Result Key Cluster Size Size Length Avg Time
invocation 1 1 10 5.610403293s
invocation 1 10 10 5.301337639s
invocation 1 100 10 5.486271444s
invocation 1 500 10 6.296638751s
invocation 1 250 10 5.762855948s

benchmark_cold_start_medium.json

Result Key Cluster Size Size Length Avg Time
invocation 1 1 10 55.238085ms
invocation 1 10 10 61.081771ms
invocation 1 100 10 222.461114ms
invocation 1 500 10 834.50665ms
invocation 1 250 10 452.763019ms

benchmark_cold_start_medium_no_compilation.json

Result Key Cluster Size Size Length Avg Time
invocation 1 250 10 8.245769915s
invocation 1 10 10 8.00270275s
invocation 1 100 10 8.082384428s
invocation 1 500 10 8.734267663s
invocation 1 1 10 8.04075059s

benchmark_cold_start_small.json

Result Key Cluster Size Size Length Avg Time
invocation 1 10 10 24.271154ms
invocation 1 100 10 145.748285ms
invocation 1 1 10 11.536765ms
invocation 1 250 10 347.378239ms
invocation 1 500 10 600.119329ms

benchmark_cold_start_small_no_compilation.json

Result Key Cluster Size Size Length Avg Time
invocation 1 500 10 606.262083ms
invocation 1 10 10 39.502563ms
invocation 1 1 10 25.066505ms
invocation 1 100 10 163.143371ms
invocation 1 250 10 340.089592ms

benchmark_durability_overhead.json

Result Key Cluster Size Size Length Avg Time
durable-invocation 1 1 10 95.255815ms
durable-invocation 1 100 10 1.490117356s
not-durable-invocation 1 10 10 18.804393ms
durable-committed-invocation 1 250 10 3.437909771s
not-durable-invocation 1 250 10 538.862497ms
durable-committed-invocation 1 1 10 98.491956ms
durable-committed-invocation 1 100 10 1.485786128s
durable-committed-invocation 1 500 10 6.844458325s
durable-invocation 1 250 10 3.390712408s
durable-committed-invocation 1 10 10 280.436614ms
durable-invocation 1 10 10 276.313207ms
not-durable-invocation 1 100 10 183.402934ms
not-durable-invocation 1 1 10 5.636105ms
durable-invocation 1 500 10 6.743135188s
not-durable-invocation 1 500 10 1.10039328s

benchmark_latency_large.json

Result Key Cluster Size Size Length Avg Time
invocation 1 10 10 16.277499ms
invocation 1 100 10 90.651594ms
invocation 1 500 10 450.352744ms
invocation 1 1 10 3.554689ms
invocation 1 250 10 227.65214ms

benchmark_latency_medium.json

Result Key Cluster Size Size Length Avg Time
invocation 1 1 10 3.269838ms
invocation 1 10 10 11.056257ms
invocation 1 100 10 78.329771ms
invocation 1 500 10 405.819767ms
invocation 1 250 10 193.956784ms

benchmark_latency_small.json

Result Key Cluster Size Size Length Avg Time
invocation 1 100 10 76.654628ms
invocation 1 250 10 181.757742ms
invocation 1 500 10 364.160336ms
invocation 1 10 10 11.042028ms
invocation 1 1 10 3.013237ms

benchmark_rpc.json

Result Key Cluster Size Size Length Avg Time
worker-echo-invocation-local 1 50 10 62.077283ms
worker-process-invocation-local 1 50 10 4.089591739s
worker-echo-invocation-local 1 20 10 26.159711ms
worker-calculate-invocation-local 1 1 10 1.909971135s
worker-process-invocation-local 1 1 10 170.011997ms
worker-calculate-invocation-local 1 20 10 17.073441698s
worker-echo-invocation-local 1 1 10 4.358902ms
worker-process-invocation-local 1 20 10 1.565664779s
worker-calculate-invocation-local 1 50 10 42.740201492s

benchmark_suspend_worker.json

Result Key Cluster Size Size Length Avg Time
invocation 1 10 10 10.009643685s
invocation 1 500 10 10.11245203s
invocation 1 100 10 10.025443257s
invocation 1 1 10 10.005886024s
invocation 1 250 10 10.069831364s

benchmark_throughput.json

Result Key Cluster Size Size Length Avg Time
rust-http-calculate-invocation 1 250 10 696.509284ms
rust-http-echo-invocation 1 500 10 91.563µs
worker-calculate-invocation 1 10 10 1.909269629s
worker-process-invocation 1 50 10 86.241621ms
rust-http-process-invocation 1 100 10 20.05487ms
rust-http-echo-invocation 1 1 10 90.796µs
worker-process-invocation 1 500 10 93.417318ms
worker-process-invocation 1 1 10 100.072326ms
rust-http-calculate-invocation 1 100 10 728.291187ms
rust-http-echo-invocation 1 100 10 110.902µs
worker-calculate-invocation 1 50 10 1.901960018s
rust-http-echo-invocation 1 50 10 121.027µs
rust-http-calculate-invocation 1 1 10 689.800379ms
rust-http-process-invocation 1 250 10 20.470956ms
worker-process-invocation 1 250 10 88.530968ms
worker-calculate-invocation 1 500 10 1.905200402s
rust-http-process-invocation 1 500 10 20.265735ms
rust-http-echo-invocation 1 10 10 86.924µs
rust-http-calculate-invocation 1 50 10 728.3119ms
worker-process-invocation 1 100 10 88.567861ms
worker-echo-invocation 1 500 10 3.156371ms
rust-http-calculate-invocation 1 500 10 694.123885ms
worker-echo-invocation 1 50 10 3.074656ms
worker-echo-invocation 1 10 10 3.243428ms
worker-process-invocation 1 10 10 93.37051ms
rust-http-process-invocation 1 1 10 23.267082ms
rust-http-process-invocation 1 50 10 20.082404ms
worker-echo-invocation 1 1 10 3.104422ms
worker-calculate-invocation 1 1 10 1.905894216s
worker-calculate-invocation 1 250 10 1.910094965s
worker-calculate-invocation 1 100 10 1.907241629s
worker-echo-invocation 1 100 10 3.126974ms
rust-http-process-invocation 1 10 10 20.361332ms
rust-http-calculate-invocation 1 10 10 726.644988ms
rust-http-echo-invocation 1 250 10 83.697µs
worker-echo-invocation 1 250 10 3.132451ms

RunID: 9845084182

@afsalthaj afsalthaj merged commit bd940f6 into main Jul 9, 2024
13 checks passed
@afsalthaj afsalthaj deleted the fix_comparison_report branch July 9, 2024 07:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants