Skip to content

wip(libdd-data-pipeline-ffi): get baseline times for pipeline#1690

Draft
hoolioh wants to merge 1 commit intomainfrom
julio/rd-week-baseline-libdd-data-pipeline-ffi
Draft

wip(libdd-data-pipeline-ffi): get baseline times for pipeline#1690
hoolioh wants to merge 1 commit intomainfrom
julio/rd-week-baseline-libdd-data-pipeline-ffi

Conversation

@hoolioh
Copy link
Contributor

@hoolioh hoolioh commented Mar 7, 2026

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@github-actions
Copy link

github-actions bot commented Mar 7, 2026

Clippy Allow Annotation Report

Comparing clippy allow annotations between branches:

  • Base Branch: origin/main
  • PR Branch: origin/julio/rd-week-baseline-libdd-data-pipeline-ffi

Summary by Rule

Rule Base Branch PR Branch Change

Annotation Counts by File

File Base Branch PR Branch Change

Annotation Stats by Crate

Crate Base Branch PR Branch Change
clippy-annotation-reporter 5 5 No change (0%)
datadog-ffe-ffi 1 1 No change (0%)
datadog-ipc 28 28 No change (0%)
datadog-live-debugger 6 6 No change (0%)
datadog-live-debugger-ffi 10 10 No change (0%)
datadog-profiling-replayer 4 4 No change (0%)
datadog-remote-config 3 3 No change (0%)
datadog-sidecar 59 59 No change (0%)
libdd-common 10 10 No change (0%)
libdd-common-ffi 12 12 No change (0%)
libdd-crashtracker 12 12 No change (0%)
libdd-data-pipeline 5 5 No change (0%)
libdd-ddsketch 2 2 No change (0%)
libdd-dogstatsd-client 1 1 No change (0%)
libdd-profiling 13 13 No change (0%)
libdd-telemetry 19 19 No change (0%)
libdd-tinybytes 4 4 No change (0%)
libdd-trace-normalization 2 2 No change (0%)
libdd-trace-obfuscation 9 9 No change (0%)
libdd-trace-utils 15 15 No change (0%)
Total 220 220 No change (0%)

About This Report

This report tracks Clippy allow annotations for specific rules, showing how they've changed in this PR. Decreasing the number of these annotations generally improves code quality.

@codecov-commenter
Copy link

codecov-commenter commented Mar 7, 2026

Codecov Report

❌ Patch coverage is 0% with 3 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.40%. Comparing base (7e909c0) to head (3122985).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1690      +/-   ##
==========================================
+ Coverage   71.37%   71.40%   +0.02%     
==========================================
  Files         427      428       +1     
  Lines       62903    62906       +3     
==========================================
+ Hits        44899    44918      +19     
+ Misses      18004    17988      -16
Components Coverage Δ
libdd-crashtracker 63.00% <ø> (ø)
libdd-crashtracker-ffi 16.56% <ø> (ø)
libdd-alloc 98.77% <ø> (ø)
libdd-data-pipeline 87.96% <0.00%> (-0.06%) ⬇️
libdd-data-pipeline-ffi 75.44% <0.00%> (-0.28%) ⬇️
libdd-common 79.73% <ø> (ø)
libdd-common-ffi 73.40% <ø> (ø)
libdd-telemetry 62.48% <ø> (ø)
libdd-telemetry-ffi 16.75% <ø> (ø)
libdd-dogstatsd-client 82.64% <ø> (ø)
datadog-ipc 80.35% <ø> (ø)
libdd-profiling 81.60% <ø> (ø)
libdd-profiling-ffi 63.65% <ø> (ø)
datadog-sidecar 34.48% <ø> (ø)
datdog-sidecar-ffi 16.55% <ø> (ø)
spawn-worker 54.69% <ø> (ø)
libdd-tinybytes 93.16% <ø> (ø)
libdd-trace-normalization 81.71% <ø> (ø)
libdd-trace-obfuscation 94.69% <ø> (ø)
libdd-trace-protobuf 68.25% <ø> (ø)
libdd-trace-utils 89.08% <ø> (ø)
datadog-tracer-flare 88.95% <ø> (ø)
libdd-log 74.69% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@pr-commenter
Copy link

pr-commenter bot commented Mar 7, 2026 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-03-07 10:17:59

Comparing candidate commit 3122985 in PR branch julio/rd-week-baseline-libdd-data-pipeline-ffi with baseline commit 7e909c0 in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 56 metrics, 2 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

scenario:profile_add_sample2_frames_x1000

  • 🟥 execution_time [+34.706µs; +34.957µs] or [+4.834%; +4.869%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.241µs 26.255µs ± 9.152µs 19.092µs ± 0.747µs 34.915µs 40.420µs 45.421µs 54.309µs 184.47% 0.531 -1.198 34.77% 0.647µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.986µs; 27.523µs] or [-4.831%; +4.831%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 751.608µs 752.776µs ± 0.514µs 752.714µs ± 0.284µs 753.010µs 753.729µs 754.403µs 755.505µs 0.37% 1.316 4.116 0.07% 0.036µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [752.705µs; 752.847µs] or [-0.009%; +0.009%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.224ms 4.229ms ± 0.006ms 4.228ms ± 0.001ms 4.230ms 4.233ms 4.236ms 4.311ms 1.95% 11.325 145.318 0.15% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.228ms; 4.230ms] or [-0.020%; +0.020%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.941µs 5.012µs ± 0.036µs 5.017µs ± 0.025µs 5.034µs 5.069µs 5.072µs 5.073µs 1.10% -0.194 -0.863 0.71% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.007µs; 5.017µs] or [-0.099%; +0.099%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 13.938ms 13.988ms ± 0.028ms 13.986ms ± 0.011ms 13.996ms 14.017ms 14.101ms 14.164ms 1.27% 2.925 13.232 0.20% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [13.984ms; 13.992ms] or [-0.028%; +0.028%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.850µs 535.162µs ± 0.922µs 534.923µs ± 0.365µs 535.436µs 537.089µs 537.835µs 542.506µs 1.42% 3.298 19.746 0.17% 0.065µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1843296.386op/s 1868599.852op/s ± 3202.702op/s 1869428.142op/s ± 1275.231op/s 1870460.592op/s 1871829.266op/s 1872505.063op/s 1873183.700op/s 0.20% -3.243 19.144 0.17% 226.465op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.977µs 381.660µs ± 0.311µs 381.637µs ± 0.214µs 381.854µs 382.201µs 382.382µs 382.599µs 0.25% 0.336 -0.200 0.08% 0.022µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2613705.864op/s 2620138.259op/s ± 2135.984op/s 2620288.920op/s ± 1470.507op/s 2621721.470op/s 2623405.000op/s 2624203.786op/s 2624829.172op/s 0.17% -0.331 -0.204 0.08% 151.037op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.595µs 190.104µs ± 0.168µs 190.099µs ± 0.104µs 190.203µs 190.394µs 190.520µs 190.610µs 0.27% 0.190 0.212 0.09% 0.012µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5246317.993op/s 5260284.909op/s ± 4643.250op/s 5260403.459op/s ± 2888.877op/s 5263302.440op/s 5267527.953op/s 5269480.028op/s 5274395.703op/s 0.27% -0.184 0.210 0.09% 328.327op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.352µs 37.543µs ± 0.076µs 37.549µs ± 0.056µs 37.603µs 37.652µs 37.668µs 37.673µs 0.33% -0.425 -0.478 0.20% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26544435.860op/s 26636320.994op/s ± 53970.470op/s 26631648.164op/s ± 39809.044op/s 26673788.146op/s 26740861.112op/s 26762181.110op/s 26772050.808op/s 0.53% 0.433 -0.468 0.20% 3816.289op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.796µs 45.942µs ± 0.112µs 45.925µs ± 0.046µs 45.982µs 46.061µs 46.153µs 47.155µs 2.68% 6.489 67.511 0.24% 0.008µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21206763.827op/s 21766818.247op/s ± 52150.223op/s 21774553.609op/s ± 22008.662op/s 21791913.985op/s 21820676.255op/s 21833257.299op/s 21836090.059op/s 0.28% -6.292 64.671 0.24% 3687.578op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [535.034µs; 535.289µs] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1868155.988op/s; 1869043.716op/s] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.616µs; 381.703µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2619842.233op/s; 2620434.286op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.081µs; 190.127µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5259641.399op/s; 5260928.419op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.532µs; 37.553µs] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26628841.206op/s; 26643800.782op/s] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.926µs; 45.957µs] or [-0.034%; +0.034%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21759590.727op/s; 21774045.766op/s] or [-0.033%; +0.033%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 143.999µs 145.882µs ± 1.944µs 145.551µs ± 0.462µs 146.144µs 147.608µs 152.722µs 166.459µs 14.36% 7.004 65.194 1.33% 0.137µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [145.613µs; 146.152µs] or [-0.185%; +0.185%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.893µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.917µs 3.919µs 3.928µs 0.40% -0.595 9.724 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 254558001.892op/s 255574648.485op/s ± 204526.143op/s 255571920.345op/s ± 131876.860op/s 255701853.838op/s 255852289.679op/s 255876774.005op/s 256893295.045op/s 0.52% 0.622 9.824 0.08% 14462.182op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 79.153µs 79.784µs ± 0.422µs 79.710µs ± 0.301µs 80.076µs 80.478µs 80.969µs 81.284µs 1.97% 0.754 0.461 0.53% 0.030µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12302485.307op/s 12534180.715op/s ± 66071.334op/s 12545426.803op/s ± 47334.822op/s 12587804.947op/s 12621368.612op/s 12630010.688op/s 12633749.799op/s 0.70% -0.725 0.378 0.53% 4671.949op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 72.275µs 72.902µs ± 0.330µs 72.836µs ± 0.197µs 73.103µs 73.546µs 73.819µs 73.893µs 1.45% 0.843 0.379 0.45% 0.023µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13533076.309op/s 13717246.635op/s ± 61859.391op/s 13729484.680op/s ± 37066.693op/s 13761286.795op/s 13799771.338op/s 13821767.807op/s 13836119.189op/s 0.78% -0.821 0.332 0.45% 4374.119op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.893µs 3.912µs ± 0.003µs 3.913µs ± 0.002µs 3.914µs 3.916µs 3.917µs 3.919µs 0.17% -2.252 16.494 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255148903.883op/s 255595926.505op/s ± 167472.530op/s 255590645.542op/s ± 102677.894op/s 255701834.661op/s 255836962.322op/s 255905922.378op/s 256896701.906op/s 0.51% 2.278 16.741 0.07% 11842.096op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 69.279µs 69.772µs ± 0.347µs 69.704µs ± 0.243µs 70.018µs 70.422µs 70.700µs 70.798µs 1.57% 0.745 -0.176 0.50% 0.025µs 1 200
credit_card/is_card_number/378282246310005 throughput 14124681.704op/s 14332791.359op/s ± 70963.104op/s 14346391.876op/s ± 50117.079op/s 14390250.983op/s 14417580.655op/s 14430085.299op/s 14434303.121op/s 0.61% -0.726 -0.220 0.49% 5017.849op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.152µs 52.214µs ± 0.033µs 52.208µs ± 0.021µs 52.236µs 52.270µs 52.304µs 52.313µs 0.20% 0.554 -0.008 0.06% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19115714.989op/s 19152025.388op/s ± 12175.122op/s 19154106.760op/s ± 7612.914op/s 19160910.306op/s 19170317.256op/s 19173383.452op/s 19174635.792op/s 0.11% -0.551 -0.013 0.06% 860.911op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.029µs 6.039µs ± 0.012µs 6.035µs ± 0.003µs 6.039µs 6.070µs 6.077µs 6.132µs 1.60% 4.568 25.774 0.21% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 163082126.130op/s 165604043.489op/s ± 339549.213op/s 165688494.236op/s ± 69012.771op/s 165747648.006op/s 165813713.150op/s 165840178.737op/s 165864122.028op/s 0.11% -4.526 25.296 0.20% 24009.755op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.891µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.917µs 3.919µs 3.919µs 0.19% -1.414 13.629 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255160106.730op/s 255618539.039op/s ± 187200.941op/s 255640538.015op/s ± 86413.445op/s 255721563.728op/s 255838059.184op/s 255884930.160op/s 256999776.369op/s 0.53% 1.444 13.866 0.07% 13237.106op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.115µs 64.439µs ± 0.147µs 64.428µs ± 0.099µs 64.532µs 64.725µs 64.792µs 64.921µs 0.77% 0.445 0.227 0.23% 0.010µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15403397.200op/s 15518750.974op/s ± 35456.749op/s 15521273.000op/s ± 23929.386op/s 15544702.831op/s 15572733.157op/s 15593627.914op/s 15597075.548op/s 0.49% -0.432 0.204 0.23% 2507.171op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.995µs 58.265µs ± 0.163µs 58.222µs ± 0.076µs 58.324µs 58.575µs 58.781µs 58.863µs 1.10% 1.174 1.079 0.28% 0.011µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16988568.767op/s 17163164.063op/s ± 47732.355op/s 17175598.642op/s ± 22444.221op/s 17195595.348op/s 17219950.346op/s 17235309.435op/s 17242924.536op/s 0.39% -1.160 1.036 0.28% 3375.187op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.897µs 3.912µs ± 0.003µs 3.913µs ± 0.002µs 3.914µs 3.916µs 3.918µs 3.927µs 0.36% -0.131 8.043 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254665961.652op/s 255593313.899op/s ± 177134.833op/s 255590083.105op/s ± 105721.209op/s 255700650.170op/s 255824839.446op/s 255923937.539op/s 256624290.192op/s 0.40% 0.152 8.073 0.07% 12525.324op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.571µs 54.994µs ± 0.285µs 54.947µs ± 0.193µs 55.145µs 55.471µs 55.885µs 56.213µs 2.30% 1.220 2.123 0.52% 0.020µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17789587.110op/s 18184270.083op/s ± 93603.984op/s 18199363.933op/s ± 63837.166op/s 18258949.018op/s 18297808.742op/s 18312078.440op/s 18324587.035op/s 0.69% -1.180 1.954 0.51% 6618.801op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.146µs 52.217µs ± 0.045µs 52.208µs ± 0.023µs 52.234µs 52.292µs 52.321µs 52.527µs 0.61% 2.045 9.936 0.09% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19037820.614op/s 19150946.068op/s ± 16574.293op/s 19154224.277op/s ± 8499.557op/s 19160807.049op/s 19172530.557op/s 19175902.621op/s 19176775.008op/s 0.12% -2.025 9.763 0.09% 1171.979op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.028µs 6.039µs ± 0.014µs 6.036µs ± 0.003µs 6.040µs 6.071µs 6.078µs 6.152µs 1.92% 4.670 28.726 0.22% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 162538920.759op/s 165586409.723op/s ± 368868.475op/s 165664890.938op/s ± 89228.829op/s 165751530.060op/s 165829963.875op/s 165854397.822op/s 165905880.672op/s 0.15% -4.610 27.981 0.22% 26082.940op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ throughput [255546303.129op/s; 255602993.841op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [79.726µs; 79.843µs] or [-0.073%; +0.073%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12525023.863op/s; 12543337.566op/s] or [-0.073%; +0.073%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [72.857µs; 72.948µs] or [-0.063%; +0.063%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13708673.519op/s; 13725819.752op/s] or [-0.062%; +0.062%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255572716.423op/s; 255619136.587op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [69.724µs; 69.820µs] or [-0.069%; +0.069%] None None None
credit_card/is_card_number/378282246310005 throughput [14322956.555op/s; 14342626.163op/s] or [-0.069%; +0.069%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.209µs; 52.218µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19150338.033op/s; 19153712.743op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.037µs; 6.040µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number/x371413321323331 throughput [165556985.234op/s; 165651101.744op/s] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255592594.789op/s; 255644483.289op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.418µs; 64.459µs] or [-0.032%; +0.032%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15513837.009op/s; 15523664.938op/s] or [-0.032%; +0.032%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.242µs; 58.287µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17156548.818op/s; 17169779.309op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255568764.714op/s; 255617863.083op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.955µs; 55.034µs] or [-0.072%; +0.072%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18171297.471op/s; 18197242.695op/s] or [-0.071%; +0.071%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.211µs; 52.223µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19148649.030op/s; 19153243.105op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.037µs; 6.041µs] or [-0.031%; +0.031%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165535288.100op/s; 165637531.346op/s] or [-0.031%; +0.031%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 240.009ns 250.073ns ± 13.519ns 244.155ns ± 2.756ns 249.791ns 281.547ns 291.791ns 294.933ns 20.80% 1.927 2.475 5.39% 0.956ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [248.200ns; 251.947ns] or [-0.749%; +0.749%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.464µs 161.250µs ± 0.568µs 161.188µs ± 0.157µs 161.358µs 161.599µs 161.776µs 168.577µs 4.58% 10.809 136.963 0.35% 0.040µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.171µs; 161.328µs] or [-0.049%; +0.049%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 48.246ms 48.493ms ± 1.141ms 48.346ms ± 0.049ms 48.401ms 48.481ms 53.891ms 59.360ms 22.78% 8.652 75.477 2.35% 0.081ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [48.335ms; 48.651ms] or [-0.326%; +0.326%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.798ms 10.819ms ± 0.014ms 10.817ms ± 0.008ms 10.826ms 10.843ms 10.872ms 10.889ms 0.67% 1.814 5.693 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.817ms; 10.821ms] or [-0.018%; +0.018%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 86.621µs 86.822µs ± 0.263µs 86.783µs ± 0.046µs 86.832µs 86.999µs 87.204µs 90.267µs 4.01% 11.382 145.849 0.30% 0.019µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [86.785µs; 86.858µs] or [-0.042%; +0.042%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 188.167ns 190.673ns ± 2.084ns 190.461ns ± 1.496ns 191.664ns 194.767ns 197.563ns 198.019ns 3.97% 1.118 1.278 1.09% 0.147ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [190.384ns; 190.962ns] or [-0.151%; +0.151%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 32.961µs 33.697µs ± 0.909µs 33.183µs ± 0.147µs 34.620µs 35.620µs 35.910µs 36.871µs 11.11% 1.142 -0.046 2.69% 0.064µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.571µs; 33.823µs] or [-0.374%; +0.374%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.346µs 2.396µs ± 0.015µs 2.393µs ± 0.005µs 2.405µs 2.426µs 2.436µs 2.438µs 1.86% -0.325 2.458 0.62% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.394µs; 2.398µs] or [-0.087%; +0.087%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.237µs 3.194µs ± 1.382µs 3.001µs ± 0.039µs 3.026µs 3.657µs 13.609µs 14.588µs 386.16% 7.347 55.220 43.14% 0.098µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.003µs; 3.386µs] or [-5.994%; +5.994%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.467µs 186.001µs ± 0.339µs 186.001µs ± 0.228µs 186.193µs 186.622µs 186.894µs 187.664µs 0.89% 1.036 2.272 0.18% 0.024µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5328673.231op/s 5376330.566op/s ± 9782.604op/s 5376311.207op/s ± 6598.151op/s 5383984.242op/s 5389572.480op/s 5390804.463op/s 5391784.592op/s 0.29% -1.018 2.191 0.18% 691.735op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.870µs 17.955µs ± 0.040µs 17.948µs ± 0.023µs 17.976µs 18.037µs 18.063µs 18.086µs 0.77% 0.753 0.692 0.22% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55290409.391op/s 55696010.639op/s ± 123821.052op/s 55717988.318op/s ± 71013.390op/s 55773533.322op/s 55873800.153op/s 55917563.045op/s 55961051.108op/s 0.44% -0.739 0.665 0.22% 8755.471op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.283µs 10.400µs ± 0.052µs 10.402µs ± 0.032µs 10.432µs 10.496µs 10.516µs 10.561µs 1.53% 0.122 0.050 0.50% 0.004µs 1 200
normalization/normalize_name/normalize_name/good throughput 94685286.193op/s 96152676.244op/s ± 483217.983op/s 96138194.298op/s ± 298542.538op/s 96489164.985op/s 96935485.790op/s 97228233.720op/s 97246308.692op/s 1.15% -0.091 0.026 0.50% 34168.671op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [185.954µs; 186.048µs] or [-0.025%; +0.025%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5374974.791op/s; 5377686.341op/s] or [-0.025%; +0.025%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.949µs; 17.960µs] or [-0.031%; +0.031%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55678850.232op/s; 55713171.046op/s] or [-0.031%; +0.031%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.393µs; 10.408µs] or [-0.070%; +0.070%] None None None
normalization/normalize_name/normalize_name/good throughput [96085706.879op/s; 96219645.609op/s] or [-0.070%; +0.070%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3122985 1772877637 julio/rd-week-baseline-libdd-data-pipeline-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 3.129ms 3.161ms ± 0.015ms 3.158ms ± 0.010ms 3.171ms 3.190ms 3.196ms 3.205ms 1.52% 0.545 -0.277 0.49% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [3.158ms; 3.163ms] or [-0.068%; +0.068%] None None None

Baseline

Omitted due to size.

@dd-octo-sts
Copy link
Contributor

dd-octo-sts bot commented Mar 7, 2026

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 98.65 MB 98.65 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.70 MB 8.70 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 114.30 MB 114.30 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.29 MB 11.29 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 27.17 MB 27.17 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 76.26 KB 76.26 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 186.04 MB 186.04 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 917.20 MB 917.21 MB +0% (+4.51 KB) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.93 MB 9.93 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 76.26 KB 76.26 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 24.76 MB 24.76 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 51.43 MB 51.43 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 22.97 MB 22.97 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 77.44 KB 77.44 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 190.24 MB 190.26 MB +0% (+16.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 900.85 MB 900.86 MB +0% (+4.42 KB) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.53 MB 7.53 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 77.44 KB 77.44 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 26.52 MB 26.52 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 47.07 MB 47.07 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 86.54 MB 86.54 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 10.23 MB 10.23 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 107.16 MB 107.16 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.98 MB 11.98 MB 0% (0 B) 👌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

data-pipeline

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@hoolioh @codecov-commenter