Skip to content

ci: make code coverage dynamic#1677

Draft
hoolioh wants to merge 3 commits intojulio/rd-week-dynamic-pipelinefrom
julio/rd-week-code-coverage
Draft

ci: make code coverage dynamic#1677
hoolioh wants to merge 3 commits intojulio/rd-week-dynamic-pipelinefrom
julio/rd-week-code-coverage

Conversation

@hoolioh
Copy link
Contributor

@hoolioh hoolioh commented Mar 6, 2026

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@hoolioh hoolioh changed the base branch from main to julio/rd-week-dynamic-pipeline March 6, 2026 10:21
@hoolioh hoolioh changed the title Julio/rd week code coverage ci: make code coverage dynamic Mar 6, 2026
@pr-commenter
Copy link

pr-commenter bot commented Mar 6, 2026 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-03-06 13:14:45

Comparing candidate commit ed49658 in PR branch julio/rd-week-code-coverage with baseline commit e784a9b in branch julio/rd-week-dynamic-pipeline.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 3.262ms 3.294ms ± 0.022ms 3.288ms ± 0.008ms 3.298ms 3.337ms 3.368ms 3.436ms 4.48% 2.501 9.758 0.68% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [3.291ms; 3.297ms] or [-0.095%; +0.095%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 89.393µs 89.814µs ± 0.137µs 89.800µs ± 0.065µs 89.877µs 89.986µs 90.040µs 91.086µs 1.43% 3.855 36.394 0.15% 0.010µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [89.795µs; 89.833µs] or [-0.021%; +0.021%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.195ms 4.201ms ± 0.008ms 4.200ms ± 0.001ms 4.201ms 4.204ms 4.211ms 4.305ms 2.50% 12.128 159.579 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.200ms; 4.202ms] or [-0.026%; +0.026%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 727.335µs 728.567µs ± 0.641µs 728.526µs ± 0.397µs 728.907µs 729.595µs 730.120µs 732.358µs 0.53% 1.338 5.333 0.09% 0.045µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [728.478µs; 728.656µs] or [-0.012%; +0.012%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 47.268ms 47.776ms ± 1.219ms 47.628ms ± 0.119ms 47.743ms 47.897ms 52.583ms 61.017ms 28.11% 8.952 85.105 2.55% 0.086ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [47.607ms; 47.945ms] or [-0.354%; +0.354%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.437µs 2.472µs ± 0.025µs 2.470µs ± 0.015µs 2.484µs 2.538µs 2.549µs 2.556µs 3.49% 1.363 2.106 1.01% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.468µs; 2.475µs] or [-0.140%; +0.140%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 143.850µs 146.213µs ± 1.718µs 145.900µs ± 0.532µs 146.520µs 147.916µs 152.353µs 162.472µs 11.36% 5.535 44.002 1.17% 0.121µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [145.975µs; 146.451µs] or [-0.163%; +0.163%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.050µs 25.766µs ± 9.380µs 18.494µs ± 0.413µs 33.725µs 43.221µs 44.346µs 71.066µs 284.27% 1.010 1.140 36.31% 0.663µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.466µs; 27.066µs] or [-5.045%; +5.045%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.424µs 35.077µs ± 1.028µs 34.613µs ± 0.080µs 34.730µs 37.275µs 37.343µs 38.137µs 10.18% 1.693 0.960 2.92% 0.073µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.934µs; 35.219µs] or [-0.406%; +0.406%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.895µs 3.912µs ± 0.002µs 3.912µs ± 0.001µs 3.913µs 3.915µs 3.919µs 3.920µs 0.21% -1.298 15.143 0.06% 0.000µs 1 200
credit_card/is_card_number/ throughput 255107718.635op/s 255635959.507op/s ± 150129.417op/s 255648470.955op/s ± 70125.027op/s 255713287.388op/s 255796807.552op/s 255886368.327op/s 256752742.789op/s 0.43% 1.325 15.335 0.06% 10615.753op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 76.624µs 77.661µs ± 0.561µs 77.627µs ± 0.388µs 78.046µs 78.562µs 79.152µs 79.829µs 2.84% 0.539 0.385 0.72% 0.040µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12526777.200op/s 12877075.229op/s ± 92651.656op/s 12882066.316op/s ± 64711.696op/s 12944629.535op/s 13012684.185op/s 13032265.619op/s 13050725.438op/s 1.31% -0.495 0.271 0.72% 6551.461op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 69.904µs 70.924µs ± 0.592µs 70.866µs ± 0.406µs 71.337µs 71.992µs 72.428µs 72.803µs 2.73% 0.440 -0.209 0.83% 0.042µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13735671.132op/s 14100624.363op/s ± 117316.571op/s 14111192.620op/s ± 80792.435op/s 14189160.546op/s 14280243.975op/s 14296682.003op/s 14305358.969op/s 1.38% -0.400 -0.272 0.83% 8295.534op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.896µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.918µs 3.920µs 3.923µs 0.27% -0.374 5.703 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254899942.797op/s 255562437.007op/s ± 192820.015op/s 255580039.217op/s ± 113160.954op/s 255683269.651op/s 255793201.895op/s 255910370.175op/s 256699521.059op/s 0.44% 0.391 5.784 0.08% 13634.434op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 66.660µs 67.718µs ± 0.632µs 67.645µs ± 0.438µs 68.167µs 68.879µs 69.343µs 69.385µs 2.57% 0.539 -0.228 0.93% 0.045µs 1 200
credit_card/is_card_number/378282246310005 throughput 14412412.749op/s 14768358.103op/s ± 137082.846op/s 14783031.358op/s ± 95972.891op/s 14872470.608op/s 14970474.861op/s 14995018.623op/s 15001556.411op/s 1.48% -0.498 -0.288 0.93% 9693.221op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.154µs 52.212µs ± 0.029µs 52.208µs ± 0.017µs 52.227µs 52.261µs 52.300µs 52.330µs 0.23% 0.879 1.391 0.06% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19109446.068op/s 19152811.646op/s ± 10724.917op/s 19154134.467op/s ± 6194.025op/s 19160048.904op/s 19167757.532op/s 19171644.180op/s 19173906.231op/s 0.10% -0.875 1.377 0.06% 758.366op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.028µs 6.038µs ± 0.009µs 6.036µs ± 0.002µs 6.038µs 6.051µs 6.075µs 6.075µs 0.66% 3.306 11.118 0.14% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 164596315.864op/s 165624344.362op/s ± 235085.823op/s 165675314.378op/s ± 55135.023op/s 165724448.499op/s 165812069.061op/s 165850211.035op/s 165883400.688op/s 0.13% -3.296 11.068 0.14% 16623.078op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.891µs 3.913µs ± 0.003µs 3.912µs ± 0.001µs 3.914µs 3.917µs 3.921µs 3.935µs 0.59% 0.716 22.896 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254114118.515op/s 255588404.493op/s ± 204299.713op/s 255604715.909op/s ± 90185.254op/s 255689395.439op/s 255793300.439op/s 255851414.714op/s 256980060.016op/s 0.54% -0.657 22.860 0.08% 14446.171op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.155µs 64.489µs ± 0.167µs 64.477µs ± 0.100µs 64.579µs 64.781µs 64.974µs 65.124µs 1.00% 0.788 1.007 0.26% 0.012µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15355420.399op/s 15506578.576op/s ± 40160.663op/s 15509513.622op/s ± 23970.014op/s 15532692.185op/s 15562731.933op/s 15576686.161op/s 15587190.447op/s 0.50% -0.769 0.957 0.26% 2839.788op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.802µs 58.062µs ± 0.170µs 58.018µs ± 0.097µs 58.151µs 58.400µs 58.556µs 58.644µs 1.08% 1.099 0.931 0.29% 0.012µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17051936.947op/s 17223044.077op/s ± 50222.030op/s 17235903.127op/s ± 28998.201op/s 17260151.488op/s 17283699.052op/s 17296621.228op/s 17300512.095op/s 0.37% -1.084 0.887 0.29% 3551.234op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.913µs 3.918µs 3.921µs 3.923µs 0.28% 0.408 4.759 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254936338.199op/s 255624555.641op/s ± 208934.288op/s 255652205.821op/s ± 103344.286op/s 255746750.532op/s 255862819.590op/s 255911080.214op/s 256723891.898op/s 0.42% -0.392 4.804 0.08% 14773.885op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.588µs 54.880µs ± 0.232µs 54.843µs ± 0.165µs 55.012µs 55.347µs 55.575µs 55.934µs 1.99% 1.223 1.891 0.42% 0.016µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17878217.102op/s 18222011.057op/s ± 76789.230op/s 18233805.877op/s ± 55107.388op/s 18287689.643op/s 18307119.730op/s 18312677.117op/s 18319108.662op/s 0.47% -1.193 1.756 0.42% 5429.819op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.142µs 52.209µs ± 0.034µs 52.203µs ± 0.020µs 52.226µs 52.265µs 52.299µs 52.401µs 0.38% 1.318 4.846 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19083536.990op/s 19153973.105op/s ± 12340.087op/s 19155825.708op/s ± 7322.625op/s 19162023.743op/s 19171284.483op/s 19176777.000op/s 19178236.537op/s 0.12% -1.308 4.788 0.06% 872.576op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.027µs 6.039µs ± 0.012µs 6.036µs ± 0.003µs 6.040µs 6.067µs 6.088µs 6.106µs 1.15% 3.169 11.325 0.20% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 163770569.786op/s 165579529.591op/s ± 324843.064op/s 165660456.859op/s ± 84175.453op/s 165740237.587op/s 165826697.413op/s 165864603.868op/s 165908779.608op/s 0.15% -3.150 11.176 0.20% 22969.873op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.911µs; 3.912µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ throughput [255615153.014op/s; 255656766.001op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [77.584µs; 77.739µs] or [-0.100%; +0.100%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12864234.601op/s; 12889915.858op/s] or [-0.100%; +0.100%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [70.842µs; 71.006µs] or [-0.116%; +0.116%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14084365.415op/s; 14116883.312op/s] or [-0.115%; +0.115%] None None None
credit_card/is_card_number/37828224631 execution_time [3.913µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255535714.007op/s; 255589160.007op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [67.631µs; 67.806µs] or [-0.129%; +0.129%] None None None
credit_card/is_card_number/378282246310005 throughput [14749359.739op/s; 14787356.467op/s] or [-0.129%; +0.129%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.208µs; 52.216µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19151325.275op/s; 19154298.016op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.037µs; 6.039µs] or [-0.020%; +0.020%] None None None
credit_card/is_card_number/x371413321323331 throughput [165591763.728op/s; 165656924.996op/s] or [-0.020%; +0.020%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255560090.517op/s; 255616718.468op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.466µs; 64.512µs] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15501012.694op/s; 15512144.457op/s] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.039µs; 58.086µs] or [-0.041%; +0.041%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17216083.787op/s; 17230004.367op/s] or [-0.040%; +0.040%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.912µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255595599.358op/s; 255653511.924op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.847µs; 54.912µs] or [-0.059%; +0.059%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18211368.808op/s; 18232653.306op/s] or [-0.058%; +0.058%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.204µs; 52.213µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19152262.887op/s; 19155683.322op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.038µs; 6.041µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165534509.467op/s; 165624549.716op/s] or [-0.027%; +0.027%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 240.112ns 251.848ns ± 12.858ns 245.491ns ± 2.966ns 257.469ns 282.286ns 290.479ns 291.582ns 18.78% 1.556 1.404 5.09% 0.909ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [250.066ns; 253.630ns] or [-0.708%; +0.708%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.816ms 14.872ms ± 0.028ms 14.869ms ± 0.014ms 14.883ms 14.906ms 14.971ms 15.075ms 1.38% 2.628 14.000 0.19% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.868ms; 14.876ms] or [-0.026%; +0.026%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.951µs 5.027µs ± 0.035µs 5.033µs ± 0.034µs 5.058µs 5.071µs 5.075µs 5.079µs 0.91% -0.232 -1.377 0.69% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.022µs; 5.032µs] or [-0.096%; +0.096%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.462µs 185.955µs ± 0.226µs 185.968µs ± 0.191µs 186.117µs 186.306µs 186.403µs 186.475µs 0.27% 0.018 -0.778 0.12% 0.016µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5362641.240op/s 5377654.578op/s ± 6528.735op/s 5377272.822op/s ± 5522.777op/s 5383370.325op/s 5388226.683op/s 5390568.312op/s 5391944.489op/s 0.27% -0.013 -0.779 0.12% 461.651op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.870µs 17.960µs ± 0.047µs 17.953µs ± 0.027µs 17.991µs 18.039µs 18.094µs 18.103µs 0.84% 0.574 0.378 0.26% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55238027.158op/s 55680595.758op/s ± 145757.307op/s 55702274.625op/s ± 84985.587op/s 55772173.987op/s 55927588.909op/s 55950665.207op/s 55959603.750op/s 0.46% -0.558 0.353 0.26% 10306.598op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.204µs 10.286µs ± 0.037µs 10.280µs ± 0.021µs 10.303µs 10.346µs 10.394µs 10.472µs 1.87% 1.233 3.267 0.35% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 95494970.112op/s 97222579.958op/s ± 344101.503op/s 97280165.400op/s ± 197361.752op/s 97435802.079op/s 97634240.536op/s 97769655.206op/s 98002690.211op/s 0.74% -1.193 3.087 0.35% 24331.651op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [185.924µs; 185.986µs] or [-0.017%; +0.017%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5376749.758op/s; 5378559.397op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.953µs; 17.966µs] or [-0.036%; +0.036%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55660395.197op/s; 55700796.319op/s] or [-0.036%; +0.036%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.281µs; 10.291µs] or [-0.049%; +0.049%] None None None
normalization/normalize_name/normalize_name/good throughput [97174890.799op/s; 97270269.117op/s] or [-0.049%; +0.049%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 161.666µs 162.896µs ± 0.588µs 162.843µs ± 0.146µs 163.005µs 163.293µs 163.721µs 170.281µs 4.57% 9.923 122.875 0.36% 0.042µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [162.815µs; 162.978µs] or [-0.050%; +0.050%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.551ms 10.586ms ± 0.014ms 10.585ms ± 0.007ms 10.592ms 10.605ms 10.635ms 10.663ms 0.74% 1.700 6.695 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.584ms; 10.588ms] or [-0.018%; +0.018%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 188.770ns 191.362ns ± 1.918ns 191.238ns ± 1.298ns 192.124ns 194.606ns 198.015ns 199.542ns 4.34% 1.210 2.230 1.00% 0.136ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [191.096ns; 191.628ns] or [-0.139%; +0.139%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.960µs 534.733µs ± 0.579µs 534.619µs ± 0.229µs 534.887µs 535.366µs 537.610µs 539.043µs 0.83% 3.751 20.809 0.11% 0.041µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1855138.762op/s 1870093.007op/s ± 2016.627op/s 1870491.977op/s ± 800.113op/s 1871171.442op/s 1871978.434op/s 1872476.054op/s 1872797.810op/s 0.12% -3.723 20.546 0.11% 142.597op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 381.229µs 382.171µs ± 0.396µs 382.189µs ± 0.302µs 382.457µs 382.754µs 383.097µs 383.226µs 0.27% 0.047 -0.351 0.10% 0.028µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2609428.364op/s 2616631.479op/s ± 2711.373op/s 2616503.815op/s ± 2068.414op/s 2618852.567op/s 2620983.817op/s 2622329.658op/s 2623094.407op/s 0.25% -0.042 -0.354 0.10% 191.723op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.929µs 190.389µs ± 0.199µs 190.376µs ± 0.107µs 190.477µs 190.696µs 190.852µs 191.810µs 0.75% 2.210 12.680 0.10% 0.014µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5213496.700op/s 5252407.701op/s ± 5464.541op/s 5252776.749op/s ± 2961.506op/s 5255791.276op/s 5259598.368op/s 5261324.236op/s 5265128.232op/s 0.24% -2.179 12.424 0.10% 386.401op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.380µs 37.521µs ± 0.060µs 37.514µs ± 0.036µs 37.554µs 37.638µs 37.696µs 37.701µs 0.50% 0.590 0.383 0.16% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26524834.587op/s 26651526.446op/s ± 42288.775op/s 26656456.821op/s ± 25857.622op/s 26681132.711op/s 26710644.052op/s 26732415.114op/s 26752354.884op/s 0.36% -0.580 0.369 0.16% 2990.268op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.803µs 45.891µs ± 0.110µs 45.873µs ± 0.022µs 45.899µs 45.976µs 46.045µs 47.298µs 3.10% 10.592 131.735 0.24% 0.008µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21142756.597op/s 21791082.681op/s ± 51008.770op/s 21799077.899op/s ± 10449.143op/s 21807914.919op/s 21820668.581op/s 21824735.867op/s 21832519.829op/s 0.15% -10.437 129.005 0.23% 3606.865op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.653µs; 534.814µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1869813.522op/s; 1870372.492op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [382.116µs; 382.226µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2616255.709op/s; 2617007.249op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.362µs; 190.417µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5251650.368op/s; 5253165.034op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.513µs; 37.530µs] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26645665.628op/s; 26657387.263op/s] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.875µs; 45.906µs] or [-0.033%; +0.033%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21784013.356op/s; 21798152.006op/s] or [-0.032%; +0.032%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ed49658 1772801849 julio/rd-week-code-coverage
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.288µs 3.150µs ± 1.398µs 2.985µs ± 0.027µs 3.010µs 3.320µs 13.589µs 14.980µs 401.90% 7.566 57.670 44.25% 0.099µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.956µs; 3.344µs] or [-6.148%; +6.148%] None None None

Baseline

Omitted due to size.

@dd-octo-sts
Copy link
Contributor

dd-octo-sts bot commented Mar 6, 2026 •
edited
Loading

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 97.27 MB 97.28 MB +.01% (+14.55 KB) 🔍
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.51 MB 8.51 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 112.87 MB 112.87 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.12 MB 11.12 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 27.15 MB 27.15 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 76.26 KB 76.26 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 185.89 MB 185.93 MB +.02% (+40.00 KB) 🔍
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 914.84 MB 914.84 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.93 MB 9.93 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 76.26 KB 76.26 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 24.76 MB 24.76 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 51.40 MB 51.40 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 22.96 MB 22.96 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 77.44 KB 77.44 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 190.10 MB 190.12 MB +0% (+16.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 898.43 MB 898.43 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.53 MB 7.53 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 77.44 KB 77.44 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 26.51 MB 26.51 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 47.03 MB 47.03 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 85.23 MB 85.23 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 10.04 MB 10.04 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 105.85 MB 105.85 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.78 MB 11.78 MB 0% (0 B) 👌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

ci-build

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@hoolioh