Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor data-pipeline FFI API. #620

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from
Draft

Refactor data-pipeline FFI API. #620

wants to merge 1 commit into from

Conversation

hoolioh
Copy link
Contributor

@hoolioh hoolioh commented Sep 10, 2024

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

@pr-commenter
Copy link

pr-commenter bot commented Sep 10, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-09-23 14:00:57

Comparing candidate commit 09a4537 in PR branch julio/refactor-ffi with baseline commit 5635814 in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 50 metrics, 2 unstable metrics.

scenario:redis/obfuscate_redis_string

  • 🟥 execution_time [+0.837µs; +1.305µs] or [+2.183%; +3.403%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 2.415µs 2.416µs ± 0.001µs 2.416µs ± 0.001µs 2.417µs 2.418µs 2.418µs 2.419µs 0.12% 0.695 -0.171 0.04% 0.000µs 1 200
credit_card/is_card_number/ throughput 413385376.545op/s 413857875.173op/s ± 148277.338op/s 413876181.429op/s ± 107153.416op/s 413980053.393op/s 414036087.452op/s 414059488.281op/s 414137424.986op/s 0.06% -0.694 -0.174 0.04% 10484.791op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 110.697µs 115.783µs ± 1.425µs 116.062µs ± 0.924µs 116.798µs 117.778µs 118.305µs 118.393µs 2.01% -0.668 0.196 1.23% 0.101µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 8446454.334op/s 8638140.629op/s ± 107200.583op/s 8616102.084op/s ± 68040.856op/s 8701747.968op/s 8830571.276op/s 8894754.654op/s 9033646.908op/s 4.85% 0.734 0.339 1.24% 7580.226op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 104.521µs 107.493µs ± 1.169µs 107.499µs ± 0.855µs 108.340µs 109.334µs 109.896µs 110.849µs 3.12% -0.041 -0.376 1.09% 0.083µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 9021308.042op/s 9304043.535op/s ± 101285.568op/s 9302425.466op/s ± 73997.997op/s 9380587.846op/s 9469916.313op/s 9539358.492op/s 9567425.157op/s 2.85% 0.094 -0.375 1.09% 7161.971op/s 1 200
credit_card/is_card_number/37828224631 execution_time 2.415µs 2.416µs ± 0.001µs 2.416µs ± 0.001µs 2.417µs 2.418µs 2.419µs 2.432µs 0.63% 6.363 64.373 0.06% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 411242959.240op/s 413826369.511op/s ± 241422.240op/s 413835814.066op/s ± 115557.299op/s 413970633.740op/s 414025884.571op/s 414042501.839op/s 414066661.831op/s 0.06% -6.318 63.711 0.06% 17071.130op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 101.774µs 105.758µs ± 1.380µs 105.789µs ± 1.107µs 106.944µs 107.793µs 107.871µs 107.972µs 2.06% -0.384 -0.485 1.30% 0.098µs 1 200
credit_card/is_card_number/378282246310005 throughput 9261628.828op/s 9457115.156op/s ± 124041.151op/s 9452747.643op/s ± 99215.997op/s 9547860.562op/s 9655213.369op/s 9780802.919op/s 9825730.838op/s 3.95% 0.438 -0.389 1.31% 8771.034op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 103.765µs 106.618µs ± 0.446µs 106.655µs ± 0.233µs 106.878µs 107.208µs 107.598µs 108.154µs 1.41% -1.302 8.104 0.42% 0.032µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 9246087.774op/s 9379485.624op/s ± 39427.760op/s 9376013.817op/s ± 20445.746op/s 9397613.947op/s 9442986.127op/s 9474901.742op/s 9637165.833op/s 2.79% 1.410 8.761 0.42% 2787.964op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 21.676µs 22.413µs ± 0.382µs 22.383µs ± 0.279µs 22.669µs 23.084µs 23.312µs 23.377µs 4.44% 0.334 -0.631 1.70% 0.027µs 1 200
credit_card/is_card_number/x371413321323331 throughput 42777847.234op/s 44629847.466op/s ± 756920.530op/s 44676891.456op/s ± 555233.154op/s 45224134.404op/s 45819317.377op/s 45935054.610op/s 46134869.985op/s 3.26% -0.270 -0.692 1.69% 53522.364op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 2.415µs 2.417µs ± 0.002µs 2.417µs ± 0.001µs 2.418µs 2.422µs 2.424µs 2.434µs 0.73% 2.589 11.120 0.10% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 410807626.742op/s 413671267.959op/s ± 414116.330op/s 413799270.450op/s ± 158171.439op/s 413949642.708op/s 414016455.548op/s 414045440.596op/s 414062014.419op/s 0.06% -2.570 10.931 0.10% 29282.447op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 86.967µs 87.304µs ± 0.248µs 87.266µs ± 0.070µs 87.321µs 87.721µs 88.480µs 88.962µs 1.94% 3.527 15.756 0.28% 0.018µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 11240735.801op/s 11454338.804op/s ± 32175.823op/s 11459255.471op/s ± 9226.274op/s 11470934.659op/s 11483459.400op/s 11488292.605op/s 11498564.979op/s 0.34% -3.483 15.374 0.28% 2275.174op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 79.648µs 80.443µs ± 1.032µs 80.078µs ± 0.244µs 80.467µs 82.680µs 84.510µs 85.702µs 7.02% 2.601 7.432 1.28% 0.073µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 11668326.058op/s 12433142.871op/s ± 154486.514op/s 12487808.778op/s ± 38034.097op/s 12518843.372op/s 12545249.855op/s 12554472.841op/s 12555164.883op/s 0.54% -2.503 6.750 1.24% 10923.846op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 2.415µs 2.416µs ± 0.001µs 2.416µs ± 0.001µs 2.417µs 2.418µs 2.419µs 2.420µs 0.14% 0.848 0.546 0.04% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 413265761.037op/s 413845756.327op/s ± 146829.742op/s 413849262.080op/s ± 111507.361op/s 413970281.805op/s 414019630.973op/s 414038370.383op/s 414047649.392op/s 0.05% -0.846 0.539 0.04% 10382.431op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 76.657µs 77.018µs ± 0.244µs 76.970µs ± 0.112µs 77.119µs 77.335µs 77.799µs 78.887µs 2.49% 3.402 19.700 0.32% 0.017µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 12676416.716op/s 12984162.730op/s ± 40662.550op/s 12991998.880op/s ± 18846.972op/s 13009053.326op/s 13022941.290op/s 13035366.266op/s 13045048.466op/s 0.41% -3.308 18.772 0.31% 2875.276op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 104.938µs 106.543µs ± 0.489µs 106.576µs ± 0.241µs 106.800µs 107.335µs 107.677µs 108.057µs 1.39% -0.130 0.885 0.46% 0.035µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 9254398.694op/s 9386103.216op/s ± 43082.358op/s 9382998.008op/s ± 21204.423op/s 9405601.566op/s 9456595.763op/s 9488295.865op/s 9529413.244op/s 1.56% 0.170 0.893 0.46% 3046.383op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 21.751µs 22.341µs ± 0.302µs 22.317µs ± 0.214µs 22.509µs 22.879µs 23.209µs 23.281µs 4.32% 0.646 0.297 1.35% 0.021µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 42954182.659op/s 44769439.805op/s ± 601028.033op/s 44808626.632op/s ± 427123.583op/s 45258604.770op/s 45646902.986op/s 45837898.000op/s 45974692.076op/s 2.60% -0.572 0.148 1.34% 42499.100op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [2.416µs; 2.416µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number/ throughput [413837325.360op/s; 413878424.986op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [115.586µs; 115.981µs] or [-0.171%; +0.171%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [8623283.660op/s; 8652997.599op/s] or [-0.172%; +0.172%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [107.331µs; 107.655µs] or [-0.151%; +0.151%] None None None
credit_card/is_card_number/ 378282246310005 throughput [9290006.329op/s; 9318080.740op/s] or [-0.151%; +0.151%] None None None
credit_card/is_card_number/37828224631 execution_time [2.416µs; 2.417µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/37828224631 throughput [413792910.710op/s; 413859828.312op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/378282246310005 execution_time [105.567µs; 105.950µs] or [-0.181%; +0.181%] None None None
credit_card/is_card_number/378282246310005 throughput [9439924.245op/s; 9474306.066op/s] or [-0.182%; +0.182%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [106.556µs; 106.679µs] or [-0.058%; +0.058%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [9374021.316op/s; 9384949.933op/s] or [-0.058%; +0.058%] None None None
credit_card/is_card_number/x371413321323331 execution_time [22.360µs; 22.466µs] or [-0.236%; +0.236%] None None None
credit_card/is_card_number/x371413321323331 throughput [44524945.561op/s; 44734749.372op/s] or [-0.235%; +0.235%] None None None
credit_card/is_card_number_no_luhn/ execution_time [2.417µs; 2.418µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/ throughput [413613875.419op/s; 413728660.500op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [87.270µs; 87.338µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [11449879.544op/s; 11458798.064op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [80.300µs; 80.586µs] or [-0.178%; +0.178%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [12411732.526op/s; 12454553.216op/s] or [-0.172%; +0.172%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [2.416µs; 2.416µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [413825407.137op/s; 413866105.518op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [76.984µs; 77.051µs] or [-0.044%; +0.044%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [12978527.292op/s; 12989798.168op/s] or [-0.043%; +0.043%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [106.475µs; 106.610µs] or [-0.064%; +0.064%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [9380132.415op/s; 9392074.016op/s] or [-0.064%; +0.064%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [22.299µs; 22.383µs] or [-0.188%; +0.188%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [44686143.100op/s; 44852736.510op/s] or [-0.186%; +0.186%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.843µs 26.701µs ± 11.170µs 18.464µs ± 0.495µs 35.303µs 41.020µs 45.387µs 93.528µs 406.55% 2.069 9.008 41.73% 0.790µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [25.153µs; 28.249µs] or [-5.798%; +5.798%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 142.961µs 144.081µs ± 0.475µs 144.064µs ± 0.255µs 144.305µs 144.927µs 145.249µs 146.699µs 1.83% 1.085 4.387 0.33% 0.034µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [144.015µs; 144.147µs] or [-0.046%; +0.046%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 275.565µs 276.274µs ± 0.217µs 276.255µs ± 0.115µs 276.397µs 276.584µs 276.794µs 277.362µs 0.40% 0.205 3.687 0.08% 0.015µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3605397.454op/s 3619602.392op/s ± 2849.113op/s 3619843.759op/s ± 1503.089op/s 3620956.975op/s 3623163.595op/s 3627795.853op/s 3628901.977op/s 0.25% -0.191 3.658 0.08% 201.463op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 28.077µs 28.108µs ± 0.037µs 28.081µs ± 0.003µs 28.125µs 28.171µs 28.210µs 28.233µs 0.54% 1.046 0.187 0.13% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 35418917.244op/s 35577539.607op/s ± 46401.136op/s 35611456.412op/s ± 4097.654op/s 35613968.552op/s 35615548.577op/s 35615877.528op/s 35615950.466op/s 0.01% -1.042 0.171 0.13% 3281.056op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 16.305µs 16.493µs ± 0.124µs 16.504µs ± 0.040µs 16.541µs 16.608µs 16.676µs 17.871µs 8.28% 6.752 74.022 0.75% 0.009µs 1 200
normalization/normalize_name/normalize_name/good throughput 55956206.207op/s 60634865.456op/s ± 435546.377op/s 60590718.427op/s ± 145952.519op/s 60900679.768op/s 61143991.192op/s 61296067.113op/s 61330816.344op/s 1.22% -6.090 64.766 0.72% 30797.780op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [276.243µs; 276.304µs] or [-0.011%; +0.011%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3619207.533op/s; 3619997.252op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [28.103µs; 28.113µs] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [35571108.856op/s; 35583970.359op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/good execution_time [16.476µs; 16.510µs] or [-0.104%; +0.104%] None None None
normalization/normalize_name/normalize_name/good throughput [60574502.917op/s; 60695227.995op/s] or [-0.100%; +0.100%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.132µs 1.197µs ± 0.023µs 1.206µs ± 0.010µs 1.214µs 1.216µs 1.217µs 1.218µs 1.00% -1.477 1.285 1.91% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.193µs; 1.200µs] or [-0.266%; +0.266%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 537.579µs 538.470µs ± 0.679µs 538.222µs ± 0.321µs 539.199µs 539.664µs 539.849µs 540.629µs 0.45% 0.801 -0.657 0.13% 0.048µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1849698.706op/s 1857118.121op/s ± 2338.919op/s 1857968.474op/s ± 1109.277op/s 1858872.538op/s 1859894.559op/s 1860119.172op/s 1860190.287op/s 0.12% -0.799 -0.663 0.13% 165.387op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 467.129µs 467.689µs ± 0.297µs 467.687µs ± 0.196µs 467.871µs 468.038µs 468.406µs 469.311µs 0.35% 1.524 7.189 0.06% 0.021µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2130782.256op/s 2138174.738op/s ± 1357.004op/s 2138182.521op/s ± 897.626op/s 2139256.356op/s 2140078.308op/s 2140480.198op/s 2140737.491op/s 0.12% -1.511 7.109 0.06% 95.955op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 184.531µs 184.898µs ± 0.273µs 184.845µs ± 0.108µs 184.966µs 185.494µs 185.760µs 186.326µs 0.80% 2.020 5.446 0.15% 0.019µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5366933.198op/s 5408396.621op/s ± 7972.677op/s 5409940.251op/s ± 3158.309op/s 5412780.868op/s 5417182.474op/s 5419074.119op/s 5419145.135op/s 0.17% -2.006 5.363 0.15% 563.753op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 44.743µs 44.861µs ± 0.066µs 44.850µs ± 0.029µs 44.879µs 45.013µs 45.065µs 45.222µs 0.83% 1.736 4.907 0.15% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 22112887.994op/s 22291307.443op/s ± 32914.980op/s 22296531.868op/s ± 14623.699op/s 22311282.730op/s 22330341.158op/s 22340558.757op/s 22349763.483op/s 0.24% -1.719 4.811 0.15% 2327.441op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 49.746µs 49.838µs ± 0.115µs 49.816µs ± 0.051µs 49.884µs 49.963µs 50.013µs 51.129µs 2.64% 7.199 77.257 0.23% 0.008µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19558260.761op/s 20064991.199op/s ± 45588.312op/s 20073810.941op/s ± 20468.614op/s 20092820.655op/s 20096826.041op/s 20100331.506op/s 20101930.814op/s 0.14% -7.012 74.404 0.23% 3223.580op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [538.375µs; 538.564µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1856793.970op/s; 1857442.273op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [467.648µs; 467.730µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2137986.671op/s; 2138362.806op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [184.860µs; 184.936µs] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5407291.684op/s; 5409501.557op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [44.851µs; 44.870µs] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [22286745.744op/s; 22295869.143op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [49.822µs; 49.854µs] or [-0.032%; +0.032%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20058673.098op/s; 20071309.301op/s] or [-0.031%; +0.031%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.427µs 3.229µs ± 1.576µs 3.072µs ± 0.033µs 3.106µs 3.185µs 13.812µs 18.435µs 500.13% 8.038 65.847 48.68% 0.111µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.011µs; 3.448µs] or [-6.764%; +6.764%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 38.735µs 39.420µs ± 1.230µs 38.847µs ± 0.050µs 38.979µs 42.080µs 42.108µs 42.369µs 9.06% 1.694 0.901 3.11% 0.087µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [39.249µs; 39.590µs] or [-0.432%; +0.432%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 298.411ns 307.464ns ± 11.799ns 301.789ns ± 2.328ns 307.770ns 335.395ns 345.879ns 346.975ns 14.97% 1.943 2.747 3.83% 0.834ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [305.828ns; 309.099ns] or [-0.532%; +0.532%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.983ms 9.025ms ± 0.026ms 9.022ms ± 0.013ms 9.036ms 9.061ms 9.076ms 9.210ms 2.08% 3.272 20.155 0.28% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [9.022ms; 9.029ms] or [-0.039%; +0.039%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 73.182µs 73.324µs ± 0.149µs 73.304µs ± 0.032µs 73.337µs 73.490µs 73.642µs 75.121µs 2.48% 9.160 105.767 0.20% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [73.303µs; 73.345µs] or [-0.028%; +0.028%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.692µs 2.721µs ± 0.016µs 2.721µs ± 0.008µs 2.727µs 2.756µs 2.767µs 2.772µs 1.89% 0.835 1.024 0.58% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.719µs; 2.723µs] or [-0.081%; +0.081%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Sep 10, 2024

Codecov Report

Attention: Patch coverage is 91.27907% with 15 lines in your changes missing coverage. Please review.

Project coverage is 73.74%. Comparing base (48d6360) to head (09a4537).
Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #620      +/-   ##
==========================================
+ Coverage   73.56%   73.74%   +0.17%     
==========================================
  Files         255      255              
  Lines       36941    37080     +139     
==========================================
+ Hits        27176    27345     +169     
+ Misses       9765     9735      -30     
Components Coverage Δ
crashtracker 20.53% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 93.21% <91.27%> (+1.55%) ⬆️
data-pipeline-ffi 82.50% <91.27%> (+82.50%) ⬆️
ddcommon 83.21% <ø> (+0.13%) ⬆️
ddcommon-ffi 69.90% <ø> (+0.38%) ⬆️
ddtelemetry 59.10% <ø> (ø)
ipc 83.58% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 40.10% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 94.77% <ø> (ø)
trace-mini-agent 72.47% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.41% <ø> (ø)

@hoolioh hoolioh force-pushed the julio/refactor-ffi branch 7 times, most recently from 479a72c to 204bbba Compare September 11, 2024 19:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants