Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Serverless Mini Agent] Bump datadog-serverless-trace-mini-agent version to 0.9.0 #723

Merged
merged 2 commits into from
Nov 11, 2024
Merged

[Serverless Mini Agent] Bump datadog-serverless-trace-mini-agent version to 0.9.0 #723

merged 2 commits into from
Nov 11, 2024
+2 −2

Conversation

duncanpharvey
Copy link
Contributor

What does this PR do?

Bumps Serverless Mini Agent Version to 0.9.0.

Motivation

Upcoming release of version 0.9.0.

Additional Notes

How to test the change?

See https://datadoghq.atlassian.net/wiki/spaces/SLS/pages/2977497119/Serverless+Mini+Agent#Testing

@pr-commenter
Copy link

pr-commenter bot commented Nov 8, 2024 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2024-11-11 16:08:13

Comparing candidate commit 58fc62f in PR branch duncan-harvey/serverless-mini-agent-bump-version with baseline commit 5a20849 in branch main.

Found 0 performance improvements and 2 performance regressions! Performance is the same for 49 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟥 execution_time [+9.150µs; +9.221µs] or [+14.626%; +14.739%]
  • 🟥 throughput [-2053941.980op/s; -2038761.783op/s] or [-12.850%; -12.755%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 58fc62f 1731340660 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 506.400µs 507.091µs ± 0.368µs 507.080µs ± 0.234µs 507.297µs 507.648µs 508.267µs 508.840µs 0.35% 0.994 3.220 0.07% 0.026µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1965254.304op/s 1972034.981op/s ± 1430.713op/s 1972076.556op/s ± 908.798op/s 1973026.064op/s 1974164.527op/s 1974631.647op/s 1974722.851op/s 0.13% -0.985 3.179 0.07% 101.167op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 467.534µs 468.408µs ± 0.300µs 468.438µs ± 0.202µs 468.609µs 468.856µs 469.181µs 469.265µs 0.18% -0.135 0.224 0.06% 0.021µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2130993.517op/s 2134891.323op/s ± 1367.179op/s 2134753.626op/s ± 919.673op/s 2135747.672op/s 2137186.665op/s 2138086.811op/s 2138881.156op/s 0.19% 0.139 0.223 0.06% 96.674op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 179.808µs 180.230µs ± 0.169µs 180.227µs ± 0.121µs 180.344µs 180.514µs 180.617µs 180.793µs 0.31% 0.237 -0.168 0.09% 0.012µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5531195.063op/s 5548483.142op/s ± 5202.620op/s 5548572.475op/s ± 3735.810op/s 5552353.736op/s 5556338.751op/s 5558145.937op/s 5561482.528op/s 0.23% -0.232 -0.174 0.09% 367.881op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 44.840µs 45.035µs ± 0.099µs 45.031µs ± 0.078µs 45.109µs 45.192µs 45.257µs 45.313µs 0.63% 0.207 -0.578 0.22% 0.007µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 22068943.065op/s 22205055.513op/s ± 48572.812op/s 22207100.776op/s ± 38558.783op/s 22245551.127op/s 22276010.777op/s 22294247.598op/s 22301752.839op/s 0.43% -0.198 -0.586 0.22% 3434.617op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 49.023µs 49.169µs ± 0.046µs 49.167µs ± 0.020µs 49.196µs 49.239µs 49.281µs 49.307µs 0.29% -0.314 1.123 0.09% 0.003µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20280892.642op/s 20338079.791op/s ± 19067.519op/s 20338701.075op/s ± 8185.915op/s 20344459.124op/s 20368410.563op/s 20392299.838op/s 20398597.768op/s 0.29% 0.323 1.129 0.09% 1348.277op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [507.040µs; 507.142µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1971836.698op/s; 1972233.264op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [468.367µs; 468.450µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2134701.845op/s; 2135080.801op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [180.206µs; 180.253µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5547762.109op/s; 5549204.175op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [45.021µs; 45.049µs] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [22198323.788op/s; 22211787.237op/s] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [49.163µs; 49.175µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20335437.216op/s; 20340722.365op/s] or [-0.013%; +0.013%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 58fc62f 1731340660 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 9.013ms 9.044ms ± 0.019ms 9.041ms ± 0.007ms 9.050ms 9.064ms 9.098ms 9.237ms 2.17% 5.791 51.693 0.21% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [9.041ms; 9.046ms] or [-0.030%; +0.030%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 58fc62f 1731340660 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 70.062µs 70.243µs ± 0.165µs 70.237µs ± 0.030µs 70.264µs 70.308µs 70.519µs 72.383µs 3.06% 11.038 140.231 0.23% 0.012µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [70.220µs; 70.266µs] or [-0.033%; +0.033%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 58fc62f 1731340660 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 140.650µs 141.397µs ± 0.411µs 141.327µs ± 0.175µs 141.515µs 142.076µs 142.724µs 144.378µs 2.16% 2.775 14.612 0.29% 0.029µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [141.340µs; 141.454µs] or [-0.040%; +0.040%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 58fc62f 1731340660 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 293.469ns 305.936ns ± 15.678ns 298.702ns ± 4.147ns 306.333ns 338.863ns 351.364ns 359.405ns 20.32% 1.589 1.349 5.11% 1.109ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [303.763ns; 308.109ns] or [-0.710%; +0.710%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 58fc62f 1731340660 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 36.748µs 37.417µs ± 1.179µs 36.890µs ± 0.053µs 36.944µs 39.975µs 40.080µs 40.322µs 9.30% 1.701 0.920 3.14% 0.083µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [37.254µs; 37.580µs] or [-0.437%; +0.437%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 58fc62f 1731340660 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.395µs 3.294µs ± 1.412µs 3.148µs ± 0.021µs 3.166µs 3.200µs 14.065µs 15.048µs 378.02% 7.552 57.314 42.75% 0.100µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.098µs; 3.489µs] or [-5.940%; +5.940%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 58fc62f 1731340660 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.131µs 1.192µs ± 0.024µs 1.194µs ± 0.015µs 1.213µs 1.217µs 1.218µs 1.219µs 2.05% -1.110 0.526 2.01% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.189µs; 1.196µs] or [-0.279%; +0.279%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 58fc62f 1731340660 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 19.909µs 26.281µs ± 10.588µs 21.258µs ± 0.427µs 34.996µs 39.137µs 41.519µs 102.960µs 384.34% 3.787 22.190 40.19% 0.749µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.813µs; 27.748µs] or [-5.584%; +5.584%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 58fc62f 1731340660 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 4.598µs 4.612µs ± 0.008µs 4.613µs ± 0.005µs 4.618µs 4.628µs 4.630µs 4.649µs 0.79% 0.510 0.848 0.18% 0.001µs 1 200
credit_card/is_card_number/ throughput 215081264.110op/s 216803144.995op/s ± 391606.921op/s 216787838.437op/s ± 245329.135op/s 217093385.502op/s 217390966.474op/s 217418120.150op/s 217507050.168op/s 0.33% -0.496 0.798 0.18% 27690.791op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 93.213µs 93.545µs ± 0.366µs 93.502µs ± 0.096µs 93.596µs 93.758µs 94.443µs 97.909µs 4.71% 8.899 99.999 0.39% 0.026µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 10213615.379op/s 10690200.992op/s ± 40488.204op/s 10694940.224op/s ± 10996.217op/s 10706416.088op/s 10717662.118op/s 10719777.088op/s 10728135.608op/s 0.31% -8.635 95.527 0.38% 2862.948op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 85.219µs 85.366µs ± 0.310µs 85.313µs ± 0.024µs 85.343µs 85.403µs 86.168µs 89.015µs 4.34% 9.049 96.666 0.36% 0.022µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 11234040.285op/s 11714403.187op/s ± 41250.694op/s 11721540.114op/s ± 3230.527op/s 11723955.494op/s 11728635.301op/s 11730779.509op/s 11734500.366op/s 0.11% -8.870 93.281 0.35% 2916.865op/s 1 200
credit_card/is_card_number/37828224631 execution_time 4.599µs 4.613µs ± 0.009µs 4.613µs ± 0.006µs 4.618µs 4.628µs 4.631µs 4.632µs 0.42% 0.223 -0.907 0.19% 0.001µs 1 200
credit_card/is_card_number/37828224631 throughput 215887012.688op/s 216782774.908op/s ± 413022.619op/s 216789469.028op/s ± 297950.238op/s 217117886.801op/s 217385463.107op/s 217413301.954op/s 217425374.535op/s 0.29% -0.217 -0.912 0.19% 29205.109op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 81.584µs 82.064µs ± 0.209µs 82.053µs ± 0.108µs 82.152µs 82.368µs 82.787µs 83.050µs 1.21% 1.367 3.921 0.25% 0.015µs 1 200
credit_card/is_card_number/378282246310005 throughput 12041003.367op/s 12185671.183op/s ± 30929.480op/s 12187252.743op/s ± 16052.522op/s 12204433.566op/s 12223969.310op/s 12240862.413op/s 12257354.614op/s 0.58% -1.337 3.798 0.25% 2187.045op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 58.860µs 58.894µs ± 0.019µs 58.895µs ± 0.016µs 58.907µs 58.928µs 58.939µs 58.950µs 0.09% 0.432 -0.510 0.03% 0.001µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 16963548.726op/s 16979771.043op/s ± 5595.656op/s 16979384.481op/s ± 4736.583op/s 16985249.585op/s 16987070.291op/s 16987922.572op/s 16989515.770op/s 0.06% -0.431 -0.512 0.03% 395.673op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.818µs 6.830µs ± 0.018µs 6.823µs ± 0.002µs 6.827µs 6.867µs 6.904µs 6.922µs 1.45% 2.736 7.601 0.27% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 144465773.486op/s 146414635.218op/s ± 387929.393op/s 146559527.643op/s ± 51087.617op/s 146607250.898op/s 146634223.814op/s 146646594.018op/s 146661163.190op/s 0.07% -2.719 7.482 0.26% 27430.750op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 4.596µs 4.612µs ± 0.009µs 4.611µs ± 0.007µs 4.618µs 4.628µs 4.629µs 4.631µs 0.43% 0.357 -0.782 0.19% 0.001µs 1 200
credit_card/is_card_number_no_luhn/ throughput 215931246.058op/s 216835958.899op/s ± 401900.515op/s 216868261.339op/s ± 307595.435op/s 217160022.075op/s 217396263.495op/s 217416488.302op/s 217599866.450op/s 0.34% -0.351 -0.787 0.18% 28418.658op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 73.345µs 73.692µs ± 0.141µs 73.710µs ± 0.086µs 73.774µs 73.874µs 73.963µs 74.571µs 1.17% 0.952 6.454 0.19% 0.010µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 13409972.642op/s 13570116.734op/s ± 25829.911op/s 13566645.750op/s ± 15843.293op/s 13585848.316op/s 13612368.404op/s 13619568.774op/s 13634284.772op/s 0.50% -0.909 6.173 0.19% 1826.451op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 65.267µs 65.433µs ± 0.123µs 65.416µs ± 0.102µs 65.525µs 65.680µs 65.709µs 65.728µs 0.48% 0.543 -0.650 0.19% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 15214276.679op/s 15282945.753op/s ± 28720.680op/s 15286803.670op/s ± 23776.826op/s 15309971.385op/s 15319039.728op/s 15319850.222op/s 15321583.515op/s 0.23% -0.537 -0.659 0.19% 2030.859op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 4.599µs 4.617µs ± 0.010µs 4.617µs ± 0.008µs 4.625µs 4.633µs 4.635µs 4.637µs 0.44% 0.014 -0.931 0.21% 0.001µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 215644522.251op/s 216603317.410op/s ± 459051.616op/s 216587708.648op/s ± 371664.659op/s 216958208.895op/s 217368272.962op/s 217408181.667op/s 217438529.947op/s 0.39% -0.007 -0.932 0.21% 32459.851op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 71.062µs 71.748µs ± 0.218µs 71.717µs ± 0.080µs 71.815µs 72.149µs 72.392µs 72.503µs 1.10% 0.535 1.748 0.30% 0.015µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 13792550.387op/s 13937847.152op/s ± 42309.288op/s 13943674.531op/s ± 15604.855op/s 13958164.937op/s 14009900.049op/s 14045360.678op/s 14072286.521op/s 0.92% -0.503 1.730 0.30% 2991.718op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 58.857µs 58.891µs ± 0.021µs 58.891µs ± 0.016µs 58.904µs 58.930µs 58.942µs 59.003µs 0.19% 1.103 2.758 0.04% 0.002µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 16948289.075op/s 16980522.510op/s ± 6146.696op/s 16980635.284op/s ± 4510.357op/s 16985902.975op/s 16987803.437op/s 16988753.921op/s 16990351.180op/s 0.06% -1.099 2.736 0.04% 434.637op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.817µs 6.833µs ± 0.027µs 6.822µs ± 0.003µs 6.827µs 6.898µs 6.913µs 7.046µs 3.27% 3.534 18.827 0.40% 0.002µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 141928731.751op/s 146341971.365op/s ± 573878.503op/s 146574395.792op/s ± 55069.843op/s 146626571.999op/s 146645297.969op/s 146651351.391op/s 146698224.871op/s 0.08% -3.438 17.692 0.39% 40579.338op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [4.611µs; 4.614µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number/ throughput [216748872.042op/s; 216857417.948op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [93.494µs; 93.596µs] or [-0.054%; +0.054%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [10684589.716op/s; 10695812.268op/s] or [-0.052%; +0.052%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [85.323µs; 85.409µs] or [-0.050%; +0.050%] None None None
credit_card/is_card_number/ 378282246310005 throughput [11708686.238op/s; 11720120.137op/s] or [-0.049%; +0.049%] None None None
credit_card/is_card_number/37828224631 execution_time [4.612µs; 4.614µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/37828224631 throughput [216725533.945op/s; 216840015.870op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/378282246310005 execution_time [82.035µs; 82.093µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number/378282246310005 throughput [12181384.654op/s; 12189957.711op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [58.891µs; 58.896µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [16978995.539op/s; 16980546.547op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.827µs; 6.832µs] or [-0.037%; +0.037%] None None None
credit_card/is_card_number/x371413321323331 throughput [146360871.935op/s; 146468398.501op/s] or [-0.037%; +0.037%] None None None
credit_card/is_card_number_no_luhn/ execution_time [4.611µs; 4.613µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ throughput [216780259.353op/s; 216891658.445op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [73.672µs; 73.711µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [13566536.957op/s; 13573696.511op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [65.416µs; 65.450µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [15278965.343op/s; 15286926.163op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [4.615µs; 4.618µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [216539697.271op/s; 216666937.549op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [71.718µs; 71.778µs] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [13931983.492op/s; 13943710.813op/s] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [58.888µs; 58.894µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [16979670.637op/s; 16981374.383op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.830µs; 6.837µs] or [-0.055%; +0.055%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [146262437.324op/s; 146421505.406op/s] or [-0.054%; +0.054%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 58fc62f 1731340660 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.634µs 2.682µs ± 0.020µs 2.677µs ± 0.009µs 2.691µs 2.725µs 2.733µs 2.736µs 2.22% 0.542 0.461 0.76% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.679µs; 2.685µs] or [-0.106%; +0.106%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 58fc62f 1731340660 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 271.257µs 273.220µs ± 0.972µs 273.167µs ± 0.610µs 273.810µs 274.732µs 275.913µs 276.769µs 1.32% 0.459 0.471 0.35% 0.069µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3613121.412op/s 3660096.768op/s ± 13002.212op/s 3660770.550op/s ± 8176.372op/s 3668612.071op/s 3680345.991op/s 3685802.435op/s 3686536.731op/s 0.70% -0.435 0.425 0.35% 919.395op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 25.775µs 25.876µs ± 0.077µs 25.867µs ± 0.047µs 25.915µs 25.994µs 26.049µs 26.492µs 2.42% 3.296 21.388 0.30% 0.005µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 37747029.380op/s 38646269.116op/s ± 113540.349op/s 38658914.948op/s ± 69747.294op/s 38726214.481op/s 38767401.443op/s 38783299.693op/s 38796914.986op/s 0.36% -3.187 20.262 0.29% 8028.515op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 15.451µs 15.509µs ± 0.062µs 15.495µs ± 0.028µs 15.524µs 15.612µs 15.661µs 16.078µs 3.76% 4.305 33.414 0.40% 0.004µs 1 200
normalization/normalize_name/normalize_name/good throughput 62197725.533op/s 64479769.526op/s ± 254648.027op/s 64535507.092op/s ± 115833.616op/s 64649512.112op/s 64696090.252op/s 64711600.860op/s 64721044.209op/s 0.29% -4.109 30.916 0.39% 18006.335op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [273.086µs; 273.355µs] or [-0.049%; +0.049%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3658294.786op/s; 3661898.749op/s] or [-0.049%; +0.049%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [25.865µs; 25.887µs] or [-0.041%; +0.041%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [38630533.516op/s; 38662004.716op/s] or [-0.041%; +0.041%] None None None
normalization/normalize_name/normalize_name/good execution_time [15.500µs; 15.518µs] or [-0.056%; +0.056%] None None None
normalization/normalize_name/normalize_name/good throughput [64444477.759op/s; 64515061.293op/s] or [-0.055%; +0.055%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Nov 8, 2024 •
edited
Loading

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 71.36%. Comparing base (5a20849) to head (58fc62f).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main     #723      +/-   ##
==========================================
+ Coverage   71.34%   71.36%   +0.01%     
==========================================
  Files         287      287              
  Lines       42739    42739              
==========================================
+ Hits        30492    30499       +7     
+ Misses      12247    12240       -7
Components Coverage Δ
crashtracker 44.95% <ø> (ø)
crashtracker-ffi 9.20% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 91.95% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 83.46% <ø> (ø)
ddcommon-ffi 69.12% <ø> (ø)
ddtelemetry 59.10% <ø> (ø)
ddtelemetry-ffi 22.13% <ø> (ø)
dogstatsd 89.45% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 82.75% <ø> (ø)
profiling 84.30% <ø> (ø)
profiling-ffi 77.46% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 37.42% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 94.77% <ø> (ø)
trace-mini-agent 72.18% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.77% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.14% <ø> (ø)

@duncanpharvey duncanpharvey marked this pull request as ready for review November 11, 2024 15:31
@duncanpharvey duncanpharvey requested review from a team as code owners November 11, 2024 15:31
@duncanpharvey duncanpharvey enabled auto-merge (squash) November 11, 2024 16:24
@duncanpharvey duncanpharvey merged commit 5048b73 into main Nov 11, 2024
32 checks passed
@duncanpharvey duncanpharvey deleted the duncan-harvey/serverless-mini-agent-bump-version branch November 11, 2024 16:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nina9753 nina9753 nina9753 approved these changes

Assignees
No one assigned
Labels
mini-agent
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@duncanpharvey @codecov-commenter @nina9753