Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

verify json schema #566

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

verify json schema #566

wants to merge 2 commits into from

Conversation

pawelchcki
Copy link
Contributor

Add verification of schema and examples

@pawelchcki pawelchcki requested a review from a team as a code owner August 1, 2024 18:41
@pawelchcki pawelchcki force-pushed the pawel/dsn/crashtracker-rfc-verification branch 2 times, most recently from 76fe816 to 46790aa Compare August 1, 2024 18:47
@pawelchcki pawelchcki force-pushed the pawel/dsn/crashtracker-rfc-verification branch from 46790aa to afd6aa6 Compare August 1, 2024 18:53
@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 70.45%. Comparing base (eb62a5e) to head (afd6aa6).

Additional details and impacted files 
@@                          Coverage Diff                           @@
##           dsn/crashtracker-errortracking-rfc     #566      +/-   ##
======================================================================
- Coverage                               70.50%   70.45%   -0.05%     
======================================================================
  Files                                     213      213              
  Lines                                   28412    28429      +17     
======================================================================
  Hits                                    20031    20031              
- Misses                                   8381     8398      +17
Components Coverage Δ
crashtracker 25.21% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 50.00% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 86.23% <ø> (ø)
ddcommon-ffi 74.58% <ø> (ø)
ddtelemetry 58.95% <ø> (ø)
ipc 84.18% <ø> (ø)
profiling 78.09% <ø> (ø)
profiling-ffi 56.76% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 35.42% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 54.98% <ø> (ø)
trace-mini-agent 71.14% <ø> (ø)
trace-normalization 98.24% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.16% <ø> (ø)
trace-utils 91.03% <ø> (-0.60%) ⬇️

@pr-commenter
Copy link

pr-commenter bot commented Aug 1, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-08-01 19:07:58

Comparing candidate commit afd6aa6 in PR branch pawel/dsn/crashtracker-rfc-verification with baseline commit eb62a5e in branch dsn/crashtracker-errortracking-rfc.

Found 1 performance improvements and 0 performance regressions! Performance is the same for 41 metrics, 2 unstable metrics.

scenario:tags/replace_trace_tags

  • 🟩 execution_time [-56.920ns; -55.374ns] or [-2.449%; -2.383%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz afd6aa6 1722538380 pawel/dsn/crashtracker-rfc-verification
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 578.224ns 591.309ns ± 6.148ns 590.287ns ± 3.906ns 594.749ns 603.609ns 609.237ns 611.231ns 3.55% 0.649 0.524 1.04% 0.435ns 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 439.087ns 453.230ns ± 3.534ns 454.084ns ± 0.297ns 454.383ns 454.921ns 456.435ns 456.551ns 0.54% -3.400 9.983 0.78% 0.250ns 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 192.961ns 202.083ns ± 3.096ns 203.233ns ± 1.911ns 204.145ns 205.824ns 208.218ns 214.813ns 5.70% -0.254 1.142 1.53% 0.219ns 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.020ns 43.333ns ± 7.159ns 40.243ns ± 2.603ns 46.727ns 58.828ns 59.117ns 60.920ns 51.38% 1.319 0.400 16.48% 0.506ns 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 62.675ns 69.724ns ± 5.639ns 67.858ns ± 3.115ns 69.413ns 80.001ns 80.758ns 81.403ns 19.96% 0.926 -0.665 8.07% 0.399ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [590.457ns; 592.162ns] or [-0.144%; +0.144%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [452.740ns; 453.720ns] or [-0.108%; +0.108%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [201.654ns; 202.512ns] or [-0.212%; +0.212%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [42.340ns; 44.325ns] or [-2.290%; +2.290%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [68.943ns; 70.506ns] or [-1.121%; +1.121%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz afd6aa6 1722538380 pawel/dsn/crashtracker-rfc-verification
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 280.510ns 281.912ns ± 0.358ns 281.931ns ± 0.077ns 282.017ns 282.241ns 282.993ns 284.381ns 0.87% 0.890 13.795 0.13% 0.025ns 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 33.622ns 34.181ns ± 0.343ns 34.114ns ± 0.200ns 34.399ns 34.852ns 35.234ns 35.301ns 3.48% 0.840 0.639 1.00% 0.024ns 1 200
normalization/normalize_name/normalize_name/good execution_time 21.424ns 21.867ns ± 0.142ns 21.854ns ± 0.091ns 21.954ns 22.106ns 22.299ns 22.431ns 2.64% 0.610 1.160 0.65% 0.010ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [281.863ns; 281.962ns] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [34.134ns; 34.229ns] or [-0.139%; +0.139%] None None None
normalization/normalize_name/normalize_name/good execution_time [21.847ns; 21.887ns] or [-0.090%; +0.090%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz afd6aa6 1722538380 pawel/dsn/crashtracker-rfc-verification
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.873µs 41.000µs ± 36.777µs 40.308µs ± 3.075µs 43.205µs 53.936µs 111.862µs 526.451µs 1206.07% 11.635 150.493 89.48% 2.601µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [35.903µs; 46.097µs] or [-12.432%; +12.432%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz afd6aa6 1722538380 pawel/dsn/crashtracker-rfc-verification
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.621µs 2.930µs ± 1.819µs 2.763µs ± 0.023µs 2.783µs 3.006µs 3.718µs 24.030µs 769.63% 10.204 106.709 61.92% 0.129µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.678µs; 3.182µs] or [-8.603%; +8.603%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz afd6aa6 1722538380 pawel/dsn/crashtracker-rfc-verification
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 70.709µs 70.838µs ± 0.062µs 70.832µs ± 0.023µs 70.857µs 70.901µs 71.001µs 71.491µs 0.93% 6.140 59.809 0.09% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [70.829µs; 70.847µs] or [-0.012%; +0.012%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz afd6aa6 1722538380 pawel/dsn/crashtracker-rfc-verification
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 136.894µs 137.290µs ± 0.214µs 137.260µs ± 0.112µs 137.384µs 137.568µs 138.193µs 138.483µs 0.89% 2.145 8.846 0.16% 0.015µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [137.260µs; 137.319µs] or [-0.022%; +0.022%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz afd6aa6 1722538380 pawel/dsn/crashtracker-rfc-verification
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 37.461µs 37.578µs ± 0.077µs 37.574µs ± 0.030µs 37.603µs 37.634µs 37.667µs 38.360µs 2.09% 6.570 59.718 0.20% 0.005µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [37.567µs; 37.588µs] or [-0.028%; +0.028%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz afd6aa6 1722538380 pawel/dsn/crashtracker-rfc-verification
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.258µs 2.268µs ± 0.005µs 2.268µs ± 0.004µs 2.272µs 2.275µs 2.280µs 2.286µs 0.82% 0.342 -0.062 0.21% 0.000µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.267µs; 2.269µs] or [-0.029%; +0.029%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz afd6aa6 1722538380 pawel/dsn/crashtracker-rfc-verification
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.666µs 1.669µs ± 0.001µs 1.669µs ± 0.000µs 1.669µs 1.670µs 1.671µs 1.676µs 0.43% 3.761 31.932 0.05% 0.000µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.669µs; 1.669µs] or [-0.007%; +0.007%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz afd6aa6 1722538380 pawel/dsn/crashtracker-rfc-verification
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.260ns 3.427ns ± 0.015ns 3.429ns ± 0.001ns 3.430ns 3.432ns 3.433ns 3.437ns 0.24% -10.038 102.341 0.43% 0.001ns 1 200
credit_card/is_card_number/ throughput 290967666.472op/s 291772086.558op/s ± 1319102.263op/s 291660661.981op/s ± 83677.236op/s 291734286.999op/s 291858048.208op/s 292064837.101op/s 306790024.271op/s 5.19% 10.086 103.374 0.45% 93274.616op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 84.850ns 87.373ns ± 0.857ns 87.244ns ± 0.430ns 87.762ns 89.130ns 89.724ns 90.556ns 3.80% 0.737 1.960 0.98% 0.061ns 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11042837.346op/s 11446259.488op/s ± 111533.469op/s 11462120.323op/s ± 56826.456op/s 11509637.175op/s 11614049.066op/s 11708348.454op/s 11785476.997op/s 2.82% -0.637 1.817 0.97% 7886.607op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 80.948ns 82.766ns ± 0.904ns 82.649ns ± 0.450ns 83.159ns 84.422ns 85.886ns 86.567ns 4.74% 1.306 2.936 1.09% 0.064ns 1 200
credit_card/is_card_number/ 378282246310005 throughput 11551735.223op/s 12083655.395op/s ± 130134.639op/s 12099327.588op/s ± 65838.921op/s 12159271.473op/s 12262392.454op/s 12315295.668op/s 12353552.779op/s 2.10% -1.203 2.600 1.07% 9201.909op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.265ns 3.427ns ± 0.016ns 3.429ns ± 0.001ns 3.429ns 3.431ns 3.435ns 3.473ns 1.29% -9.048 86.354 0.48% 0.001ns 1 200
credit_card/is_card_number/37828224631 throughput 287945181.670op/s 291783707.992op/s ± 1467643.668op/s 291670999.374op/s ± 63781.594op/s 291738186.785op/s 291845187.792op/s 292223368.525op/s 306319354.130op/s 5.02% 9.138 87.242 0.50% 103778.079op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 77.633ns 80.328ns ± 0.818ns 80.327ns ± 0.427ns 80.690ns 81.918ns 82.556ns 82.632ns 2.87% 0.053 1.576 1.02% 0.058ns 1 200
credit_card/is_card_number/378282246310005 throughput 12101857.628op/s 12450186.347op/s ± 126852.083op/s 12449076.456op/s ± 66197.531op/s 12521294.759op/s 12647479.062op/s 12862526.033op/s 12881165.931op/s 3.47% 0.057 1.656 1.02% 8969.797op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 67.390ns 68.283ns ± 0.402ns 68.268ns ± 0.169ns 68.431ns 68.699ns 70.429ns 71.010ns 4.02% 2.965 16.896 0.59% 0.028ns 1 200
credit_card/is_card_number/37828224631000521389798 throughput 14082499.785op/s 14645325.182op/s ± 84745.246op/s 14648164.209op/s ± 36082.065op/s 14686648.721op/s 14765658.257op/s 14791462.779op/s 14839030.851op/s 1.30% -2.790 15.647 0.58% 5992.394op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 21.302ns 22.380ns ± 0.521ns 22.325ns ± 0.235ns 22.528ns 23.221ns 24.802ns 24.810ns 11.13% 1.965 6.750 2.32% 0.037ns 1 200
credit_card/is_card_number/x371413321323331 throughput 40306469.592op/s 44705046.421op/s ± 999593.933op/s 44792834.893op/s ± 473357.273op/s 45286181.347op/s 45957701.579op/s 46498599.576op/s 46943301.520op/s 4.80% -1.642 5.274 2.23% 70681.965op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.263ns 3.429ns ± 0.016ns 3.431ns ± 0.000ns 3.431ns 3.433ns 3.435ns 3.454ns 0.68% -9.607 92.250 0.48% 0.001ns 1 200
credit_card/is_card_number_no_luhn/ throughput 289503877.248op/s 291605039.044op/s ± 1459636.051op/s 291472476.442op/s ± 36994.879op/s 291508925.668op/s 291610363.370op/s 291977327.235op/s 306419847.006op/s 5.13% 9.634 92.585 0.50% 103211.855op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 66.822ns 68.035ns ± 0.705ns 67.998ns ± 0.258ns 68.228ns 68.800ns 69.963ns 75.151ns 10.52% 5.749 52.573 1.03% 0.050ns 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 13306468.050op/s 14699818.942op/s ± 144300.224op/s 14706262.718op/s ± 55849.594op/s 14766290.432op/s 14844192.344op/s 14955829.072op/s 14965086.113op/s 1.76% -5.120 44.370 0.98% 10203.567op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 62.152ns 63.152ns ± 0.424ns 63.109ns ± 0.233ns 63.353ns 63.985ns 64.482ns 64.653ns 2.45% 0.724 1.386 0.67% 0.030ns 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 15467259.324op/s 15835578.966op/s ± 105861.645op/s 15845514.445op/s ± 58386.360op/s 15896750.100op/s 15994440.884op/s 16046241.438op/s 16089565.184op/s 1.54% -0.667 1.275 0.67% 7485.549op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.267ns 3.429ns ± 0.016ns 3.431ns ± 0.001ns 3.431ns 3.433ns 3.434ns 3.439ns 0.24% -9.761 93.911 0.47% 0.001ns 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 290775693.281op/s 291608122.646op/s ± 1446550.225op/s 291475212.341op/s ± 44248.430op/s 291507115.978op/s 291607259.249op/s 292000529.424op/s 306121328.807op/s 5.02% 9.770 94.025 0.49% 102286.547op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 59.602ns 60.725ns ± 0.436ns 60.720ns ± 0.267ns 61.013ns 61.488ns 61.838ns 61.847ns 1.86% 0.107 0.064 0.72% 0.031ns 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 16168908.097op/s 16468454.727op/s ± 118204.115op/s 16469050.014op/s ± 72481.301op/s 16539961.880op/s 16668934.429op/s 16742251.100op/s 16777899.203op/s 1.88% -0.063 0.059 0.72% 8358.293op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 66.406ns 67.428ns ± 0.384ns 67.420ns ± 0.189ns 67.615ns 67.939ns 68.619ns 69.761ns 3.47% 1.670 9.739 0.57% 0.027ns 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 14334688.227op/s 14831187.474op/s ± 83780.950op/s 14832452.595op/s ± 41576.194op/s 14870669.153op/s 14951688.982op/s 15042924.212op/s 15058825.102op/s 1.53% -1.520 8.933 0.56% 5924.208op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 20.975ns 21.731ns ± 0.301ns 21.704ns ± 0.190ns 21.903ns 22.193ns 22.417ns 23.628ns 8.86% 1.335 7.067 1.38% 0.021ns 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 42322177.364op/s 46026039.563op/s ± 626651.923op/s 46073932.730op/s ± 403968.006op/s 46450727.803op/s 46893465.856op/s 47382015.535op/s 47676029.313op/s 3.48% -1.059 5.350 1.36% 44310.982op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.425ns; 3.429ns] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/ throughput [291589271.671op/s; 291954901.445op/s] or [-0.063%; +0.063%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [87.254ns; 87.492ns] or [-0.136%; +0.136%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [11430802.022op/s; 11461716.954op/s] or [-0.135%; +0.135%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [82.641ns; 82.891ns] or [-0.151%; +0.151%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12065619.986op/s; 12101690.805op/s] or [-0.149%; +0.149%] None None None
credit_card/is_card_number/37828224631 execution_time [3.425ns; 3.430ns] or [-0.067%; +0.067%] None None None
credit_card/is_card_number/37828224631 throughput [291580306.694op/s; 291987109.289op/s] or [-0.070%; +0.070%] None None None
credit_card/is_card_number/378282246310005 execution_time [80.215ns; 80.442ns] or [-0.141%; +0.141%] None None None
credit_card/is_card_number/378282246310005 throughput [12432605.868op/s; 12467766.825op/s] or [-0.141%; +0.141%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [68.228ns; 68.339ns] or [-0.082%; +0.082%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [14633580.306op/s; 14657070.058op/s] or [-0.080%; +0.080%] None None None
credit_card/is_card_number/x371413321323331 execution_time [22.308ns; 22.453ns] or [-0.323%; +0.323%] None None None
credit_card/is_card_number/x371413321323331 throughput [44566512.316op/s; 44843580.526op/s] or [-0.310%; +0.310%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.427ns; 3.432ns] or [-0.066%; +0.066%] None None None
credit_card/is_card_number_no_luhn/ throughput [291402747.526op/s; 291807330.563op/s] or [-0.069%; +0.069%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [67.937ns; 68.133ns] or [-0.144%; +0.144%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [14679820.319op/s; 14719817.565op/s] or [-0.136%; +0.136%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [63.093ns; 63.211ns] or [-0.093%; +0.093%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [15820907.560op/s; 15850250.372op/s] or [-0.093%; +0.093%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.427ns; 3.432ns] or [-0.066%; +0.066%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [291407644.697op/s; 291808600.595op/s] or [-0.069%; +0.069%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [60.665ns; 60.786ns] or [-0.100%; +0.100%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [16452072.773op/s; 16484836.680op/s] or [-0.099%; +0.099%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [67.374ns; 67.481ns] or [-0.079%; +0.079%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [14819576.240op/s; 14842798.708op/s] or [-0.078%; +0.078%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [21.689ns; 21.773ns] or [-0.192%; +0.192%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [45939191.633op/s; 46112887.492op/s] or [-0.189%; +0.189%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz afd6aa6 1722538380 pawel/dsn/crashtracker-rfc-verification
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 321.098ns 331.166ns ± 3.982ns 330.233ns ± 1.539ns 332.832ns 337.194ns 340.648ns 362.695ns 9.83% 2.891 19.004 1.20% 0.282ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [330.614ns; 331.718ns] or [-0.167%; +0.167%] None None None

Baseline

Omitted due to size.

@danielsn danielsn mentioned this pull request Aug 8, 2024
Closed
@github-actions GitHub Actions
Copy link

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. To override this behavior, add the keep-open label or update the PR.

@github-actions github-actions bot added the stale Used by actions/stale to identify PRs that have been inactive for 90+ days label Oct 31, 2024
Base automatically changed from dsn/crashtracker-errortracking-rfc to main November 13, 2024 20:33
@github-actions github-actions bot removed the stale Used by actions/stale to identify PRs that have been inactive for 90+ days label Nov 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
ci-build
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@pawelchcki @codecov-commenter @danielsn