Skip to content

Remove obsolete ref_protected from STS trust policies#1655

Open
d-niu wants to merge 1 commit intomainfrom
remove-ref-protected-from-sts-policies
Open

Remove obsolete ref_protected from STS trust policies#1655
d-niu wants to merge 1 commit intomainfrom
remove-ref-protected-from-sts-policies

Conversation

@d-niu
Copy link

@d-niu d-niu commented Mar 4, 2026

Summary

  • Remove ref_protected: "true" from dd-octo-sts trust policy claim patterns

The ref_protected OIDC claim is now obsolete in the DataDog org:

  • GitHub: The org-level "incompatible file paths on windows" push ruleset causes ALL branches to report ref_protected: true in OIDC tokens, making it useless as a security signal
  • GitLab: All branches on gitlab.ddbuild.io report ref_protected: true due to org-level pushAccessLevels: 40 config

Since the claim is universally true, it provides no actual filtering — only a false sense of security. Removing it has zero functional impact on policy enforcement.

All other constraints (subject, ref, job_workflow_ref, project_path, pipeline_source, etc.) remain unchanged and continue to provide the real security boundaries.

Ticket: https://datadoghq.atlassian.net/browse/SINT-4732

Test plan

  • Verify that the remaining policy constraints are sufficient (ref, job_workflow_ref, etc. are unchanged)
  • No functional change expected since ref_protected was already always true

🤖 Generated with Claude Code

@d-niu @claude
Remove obsolete ref_protected from STS trust policies
cc0b6bc 
The `ref_protected` OIDC claim is now universally `true` in the DataDog org
due to the org-level "incompatible file paths on windows" push ruleset,
making it useless as a security discriminator.

Ticket: https://datadoghq.atlassian.net/browse/SINT-4732

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@d-niu d-niu requested a review from a team as a code owner March 4, 2026 22:36
@codecov-commenter
Copy link

codecov-commenter commented Mar 4, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.23%. Comparing base (f79e281) to head (cc0b6bc).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1655      +/-   ##
==========================================
+ Coverage   71.20%   71.23%   +0.02%     
==========================================
  Files         425      425              
  Lines       62715    62715              
==========================================
+ Hits        44657    44672      +15     
+ Misses      18058    18043      -15
Components Coverage Δ
libdd-crashtracker 62.92% <ø> (+0.01%) ⬆️
libdd-crashtracker-ffi 15.63% <ø> (ø)
libdd-alloc 98.77% <ø> (ø)
libdd-data-pipeline 87.38% <ø> (ø)
libdd-data-pipeline-ffi 72.83% <ø> (ø)
libdd-common 79.73% <ø> (ø)
libdd-common-ffi 73.40% <ø> (ø)
libdd-telemetry 62.48% <ø> (ø)
libdd-telemetry-ffi 16.75% <ø> (ø)
libdd-dogstatsd-client 82.64% <ø> (ø)
datadog-ipc 80.86% <ø> (+0.11%) ⬆️
libdd-profiling 81.59% <ø> (ø)
libdd-profiling-ffi 63.65% <ø> (ø)
datadog-sidecar 33.45% <ø> (ø)
datdog-sidecar-ffi 12.41% <ø> (ø)
spawn-worker 54.69% <ø> (ø)
libdd-tinybytes 93.16% <ø> (ø)
libdd-trace-normalization 81.71% <ø> (ø)
libdd-trace-obfuscation 94.67% <ø> (ø)
libdd-trace-protobuf 68.00% <ø> (ø)
libdd-trace-utils 88.97% <ø> (ø)
datadog-tracer-flare 90.45% <ø> (ø)
libdd-log 74.69% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@pr-commenter
Copy link

pr-commenter bot commented Mar 4, 2026 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-03-04 22:53:06

Comparing candidate commit cc0b6bc in PR branch remove-ref-protected-from-sts-policies with baseline commit f79e281 in branch main.

Found 0 performance improvements and 2 performance regressions! Performance is the same for 55 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/ 378282246310005

  • 🟥 execution_time [+10.277µs; +10.456µs] or [+14.082%; +14.327%]
  • 🟥 throughput [-1717733.402op/s; -1690162.347op/s] or [-12.536%; -12.335%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.958µs 5.015µs ± 0.039µs 5.003µs ± 0.028µs 5.061µs 5.072µs 5.076µs 5.103µs 2.01% 0.396 -1.406 0.78% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.009µs; 5.020µs] or [-0.108%; +0.108%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 90.559µs 90.788µs ± 0.209µs 90.769µs ± 0.045µs 90.817µs 90.908µs 90.964µs 93.542µs 3.05% 11.495 149.069 0.23% 0.015µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [90.759µs; 90.817µs] or [-0.032%; +0.032%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 240.669ns 250.955ns ± 12.576ns 245.139ns ± 2.561ns 251.350ns 280.694ns 287.260ns 288.096ns 17.52% 1.707 1.617 5.00% 0.889ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [249.212ns; 252.698ns] or [-0.694%; +0.694%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 48.411ms 48.752ms ± 0.741ms 48.666ms ± 0.094ms 48.730ms 48.918ms 51.365ms 56.464ms 16.03% 8.364 75.903 1.52% 0.052ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [48.650ms; 48.855ms] or [-0.211%; +0.211%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 722.304µs 723.594µs ± 0.674µs 723.514µs ± 0.400µs 723.952µs 724.819µs 725.489µs 726.178µs 0.37% 0.805 0.936 0.09% 0.048µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [723.500µs; 723.687µs] or [-0.013%; +0.013%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.166ms 4.170ms ± 0.006ms 4.169ms ± 0.001ms 4.170ms 4.173ms 4.175ms 4.255ms 2.05% 12.025 157.261 0.15% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.169ms; 4.171ms] or [-0.021%; +0.021%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.787µs 25.981µs ± 9.926µs 18.029µs ± 0.172µs 35.285µs 43.187µs 44.292µs 65.490µs 263.25% 0.795 -0.150 38.11% 0.702µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.605µs; 27.356µs] or [-5.295%; +5.295%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.168µs 33.632µs ± 0.761µs 33.273µs ± 0.062µs 33.426µs 35.158µs 35.356µs 37.438µs 12.52% 1.934 3.033 2.26% 0.054µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.526µs; 33.737µs] or [-0.313%; +0.313%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 3.268ms 3.294ms ± 0.019ms 3.290ms ± 0.009ms 3.301ms 3.325ms 3.348ms 3.434ms 4.37% 2.714 14.401 0.57% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [3.292ms; 3.297ms] or [-0.079%; +0.079%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.925µs 535.497µs ± 1.429µs 535.097µs ± 0.548µs 535.880µs 537.736µs 538.918µs 547.823µs 2.38% 3.901 27.033 0.27% 0.101µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1825406.719op/s 1867435.622op/s ± 4934.468op/s 1868821.279op/s ± 1916.363op/s 1870294.268op/s 1871832.532op/s 1872232.085op/s 1872921.608op/s 0.22% -3.793 25.729 0.26% 348.920op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.936µs 381.981µs ± 0.341µs 381.963µs ± 0.240µs 382.205µs 382.643µs 382.787µs 382.908µs 0.25% 0.214 0.175 0.09% 0.024µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2611594.275op/s 2617934.337op/s ± 2337.910op/s 2618055.671op/s ± 1646.948op/s 2619606.760op/s 2621383.625op/s 2622624.926op/s 2625113.179op/s 0.27% -0.209 0.176 0.09% 165.315op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.640µs 190.254µs ± 0.184µs 190.243µs ± 0.117µs 190.368µs 190.552µs 190.680µs 190.987µs 0.39% 0.289 0.897 0.10% 0.013µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5235946.817op/s 5256130.089op/s ± 5083.678op/s 5256424.140op/s ± 3237.810op/s 5259531.587op/s 5263904.711op/s 5266696.145op/s 5273140.088op/s 0.32% -0.280 0.888 0.10% 359.470op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.431µs 37.599µs ± 0.066µs 37.598µs ± 0.049µs 37.648µs 37.713µs 37.753µs 37.807µs 0.55% 0.127 -0.096 0.17% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26450174.091op/s 26596527.334op/s ± 46624.596op/s 26596919.415op/s ± 34870.739op/s 26630179.126op/s 26667576.759op/s 26694082.043op/s 26715980.975op/s 0.45% -0.117 -0.104 0.17% 3296.857op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.814µs 45.892µs ± 0.040µs 45.884µs ± 0.026µs 45.917µs 45.966µs 45.983µs 46.006µs 0.27% 0.529 -0.134 0.09% 0.003µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21736074.784op/s 21790416.079op/s ± 18771.110op/s 21793960.144op/s ± 12426.745op/s 21803006.925op/s 21817388.990op/s 21824436.411op/s 21827457.826op/s 0.15% -0.525 -0.139 0.09% 1327.318op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [535.299µs; 535.696µs] or [-0.037%; +0.037%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1866751.752op/s; 1868119.492op/s] or [-0.037%; +0.037%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.934µs; 382.028µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2617610.326op/s; 2618258.349op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.229µs; 190.280µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5255425.541op/s; 5256834.638op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.590µs; 37.608µs] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26590065.613op/s; 26602989.055op/s] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.886µs; 45.897µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21787814.584op/s; 21793017.575op/s] or [-0.012%; +0.012%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.192µs 3.194µs ± 1.417µs 2.982µs ± 0.035µs 3.010µs 3.623µs 14.048µs 14.623µs 390.36% 7.325 54.875 44.26% 0.100µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.997µs; 3.390µs] or [-6.150%; +6.150%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.577ms 10.608ms ± 0.014ms 10.606ms ± 0.007ms 10.614ms 10.629ms 10.660ms 10.675ms 0.64% 1.307 3.735 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.606ms; 10.610ms] or [-0.019%; +0.019%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.342µs 2.405µs ± 0.018µs 2.403µs ± 0.005µs 2.411µs 2.439µs 2.446µs 2.448µs 1.86% -0.788 2.831 0.75% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.402µs; 2.407µs] or [-0.104%; +0.104%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 161.164µs 162.124µs ± 0.322µs 162.060µs ± 0.161µs 162.270µs 162.647µs 162.906µs 163.907µs 1.14% 1.226 4.672 0.20% 0.023µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [162.079µs; 162.169µs] or [-0.028%; +0.028%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.191µs 185.786µs ± 0.331µs 185.777µs ± 0.194µs 185.957µs 186.184µs 186.391µs 188.426µs 1.43% 3.125 21.695 0.18% 0.023µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5307115.475op/s 5382560.039op/s ± 9547.237op/s 5382807.799op/s ± 5627.864op/s 5388628.929op/s 5394703.663op/s 5397109.684op/s 5399836.277op/s 0.32% -3.052 20.988 0.18% 675.092op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.882µs 17.972µs ± 0.043µs 17.964µs ± 0.025µs 17.997µs 18.051µs 18.097µs 18.179µs 1.20% 1.182 2.650 0.24% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55008551.750op/s 55640896.169op/s ± 131758.753op/s 55667032.557op/s ± 78050.944op/s 55726507.414op/s 55802198.930op/s 55856785.034op/s 55922471.717op/s 0.46% -1.159 2.552 0.24% 9316.751op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.229µs 10.372µs ± 0.071µs 10.385µs ± 0.055µs 10.428µs 10.480µs 10.503µs 10.511µs 1.21% -0.103 -1.087 0.69% 0.005µs 1 200
normalization/normalize_name/normalize_name/good throughput 95137672.140op/s 96414721.484op/s ± 664325.535op/s 96289885.077op/s ± 510873.378op/s 97058127.740op/s 97410597.568op/s 97672393.761op/s 97759384.531op/s 1.53% 0.122 -1.089 0.69% 46974.909op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [185.740µs; 185.832µs] or [-0.025%; +0.025%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5381236.884op/s; 5383883.194op/s] or [-0.025%; +0.025%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.967µs; 17.978µs] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55622635.673op/s; 55659156.665op/s] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.362µs; 10.382µs] or [-0.095%; +0.095%] None None None
normalization/normalize_name/normalize_name/good throughput [96322652.354op/s; 96506790.614op/s] or [-0.095%; +0.095%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.896µs 3.913µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.917µs 3.919µs 3.929µs 0.42% 0.193 9.122 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 254537737.659op/s 255590676.059op/s ± 187144.150op/s 255596332.238op/s ± 106678.220op/s 255714969.451op/s 255815510.511op/s 255846856.143op/s 256680548.103op/s 0.42% -0.169 9.139 0.07% 13233.090op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 78.975µs 79.761µs ± 0.391µs 79.732µs ± 0.268µs 80.001µs 80.447µs 80.907µs 81.255µs 1.91% 0.749 0.865 0.49% 0.028µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12306891.684op/s 12537763.058op/s ± 61208.425op/s 12542062.569op/s ± 42136.083op/s 12584126.698op/s 12620245.651op/s 12643038.969op/s 12662169.988op/s 0.96% -0.716 0.776 0.49% 4328.089op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 82.478µs 83.347µs ± 0.568µs 83.245µs ± 0.374µs 83.685µs 84.369µs 85.005µs 85.649µs 2.89% 0.932 1.063 0.68% 0.040µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 11675556.143op/s 11998609.082op/s ± 81227.878op/s 12012773.815op/s ± 53941.460op/s 12052223.490op/s 12104576.741op/s 12121424.773op/s 12124473.482op/s 0.93% -0.888 0.916 0.68% 5743.678op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.854µs 3.912µs ± 0.005µs 3.912µs ± 0.001µs 3.913µs 3.916µs 3.920µs 3.922µs 0.27% -8.742 106.164 0.12% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254947369.869op/s 255634254.504op/s ± 313165.930op/s 255641573.119op/s ± 93142.869op/s 255721314.381op/s 255833582.239op/s 255876183.304op/s 259442931.281op/s 1.49% 8.857 107.896 0.12% 22144.175op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 69.163µs 69.715µs ± 0.357µs 69.668µs ± 0.223µs 69.892µs 70.330µs 70.992µs 71.044µs 1.97% 1.033 1.470 0.51% 0.025µs 1 200
credit_card/is_card_number/378282246310005 throughput 14075863.823op/s 14344422.960op/s ± 73120.677op/s 14353843.809op/s ± 46144.680op/s 14399804.170op/s 14440241.995op/s 14456896.287op/s 14458635.551op/s 0.73% -0.997 1.345 0.51% 5170.413op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.143µs 52.208µs ± 0.037µs 52.204µs ± 0.023µs 52.229µs 52.273µs 52.309µs 52.419µs 0.41% 1.503 5.165 0.07% 0.003µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19076932.799op/s 19154088.045op/s ± 13710.122op/s 19155598.281op/s ± 8524.564op/s 19163395.999op/s 19171899.938op/s 19176145.930op/s 19177887.895op/s 0.12% -1.492 5.102 0.07% 969.452op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.028µs 6.038µs ± 0.012µs 6.034µs ± 0.002µs 6.037µs 6.070µs 6.073µs 6.108µs 1.21% 3.252 11.684 0.19% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 163726360.586op/s 165630123.244op/s ± 314565.999op/s 165715295.522op/s ± 68533.071op/s 165777820.254op/s 165841064.419op/s 165882029.484op/s 165894943.148op/s 0.11% -3.234 11.526 0.19% 22243.175op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.893µs 3.911µs ± 0.003µs 3.911µs ± 0.001µs 3.912µs 3.916µs 3.918µs 3.920µs 0.22% -1.287 13.334 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255117139.790op/s 255672103.126op/s ± 166313.189op/s 255681754.247op/s ± 79784.747op/s 255757981.709op/s 255875553.663op/s 255939480.724op/s 256882769.799op/s 0.47% 1.313 13.529 0.06% 11760.118op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.120µs 64.451µs ± 0.165µs 64.422µs ± 0.102µs 64.536µs 64.745µs 64.908µs 64.942µs 0.81% 0.742 0.379 0.25% 0.012µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15398375.215op/s 15515723.052op/s ± 39547.210op/s 15522734.816op/s ± 24715.579op/s 15543900.123op/s 15570205.400op/s 15591925.522op/s 15595782.900op/s 0.47% -0.728 0.354 0.25% 2796.410op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.796µs 58.117µs ± 0.176µs 58.093µs ± 0.114µs 58.217µs 58.416µs 58.621µs 58.856µs 1.31% 1.081 2.107 0.30% 0.012µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16990542.750op/s 17206745.734op/s ± 51937.562op/s 17213866.118op/s ± 33706.438op/s 17245757.782op/s 17270235.529op/s 17299045.752op/s 17302211.223op/s 0.51% -1.054 2.007 0.30% 3672.540op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.890µs 3.912µs ± 0.003µs 3.911µs ± 0.001µs 3.913µs 3.916µs 3.918µs 3.923µs 0.30% -1.833 20.072 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254904773.578op/s 255642617.054op/s ± 176073.730op/s 255661868.033op/s ± 97034.350op/s 255747754.514op/s 255818504.085op/s 255850149.001op/s 257052326.585op/s 0.54% 1.872 20.379 0.07% 12450.293op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.591µs 55.050µs ± 0.321µs 54.998µs ± 0.182µs 55.189µs 55.599µs 56.102µs 56.665µs 3.03% 1.472 3.796 0.58% 0.023µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17647584.715op/s 18165861.230op/s ± 104891.115op/s 18182340.406op/s ± 60127.285op/s 18238343.839op/s 18292311.238op/s 18311092.191op/s 18318142.862op/s 0.75% -1.410 3.476 0.58% 7416.922op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.139µs 52.212µs ± 0.038µs 52.205µs ± 0.023µs 52.235µs 52.280µs 52.317µs 52.380µs 0.33% 1.080 1.844 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19091368.206op/s 19152709.337op/s ± 14047.615op/s 19155284.861op/s ± 8452.648op/s 19162953.221op/s 19170243.565op/s 19175735.753op/s 19179650.391op/s 0.13% -1.074 1.819 0.07% 993.316op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.028µs 6.038µs ± 0.011µs 6.035µs ± 0.003µs 6.038µs 6.049µs 6.086µs 6.119µs 1.40% 4.576 25.182 0.19% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 163413969.301op/s 165621650.382op/s ± 312303.735op/s 165695923.881op/s ± 73500.977op/s 165762604.396op/s 165826074.248op/s 165871918.953op/s 165895923.085op/s 0.12% -4.541 24.812 0.19% 22083.209op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255564739.680op/s; 255616612.439op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [79.707µs; 79.815µs] or [-0.068%; +0.068%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12529280.159op/s; 12546245.957op/s] or [-0.068%; +0.068%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [83.268µs; 83.425µs] or [-0.094%; +0.094%] None None None
credit_card/is_card_number/ 378282246310005 throughput [11987351.679op/s; 12009866.485op/s] or [-0.094%; +0.094%] None None None
credit_card/is_card_number/37828224631 execution_time [3.911µs; 3.913µs] or [-0.017%; +0.017%] None None None
credit_card/is_card_number/37828224631 throughput [255590852.718op/s; 255677656.290op/s] or [-0.017%; +0.017%] None None None
credit_card/is_card_number/378282246310005 execution_time [69.666µs; 69.765µs] or [-0.071%; +0.071%] None None None
credit_card/is_card_number/378282246310005 throughput [14334289.137op/s; 14354556.782op/s] or [-0.071%; +0.071%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.203µs; 52.213µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19152187.953op/s; 19155988.136op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.036µs; 6.039µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/x371413321323331 throughput [165586527.422op/s; 165673719.066op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.911µs; 3.912µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [255649053.717op/s; 255695152.534op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.428µs; 64.474µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15510242.189op/s; 15521203.915op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.093µs; 58.142µs] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17199547.688op/s; 17213943.781op/s] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.911µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255618214.929op/s; 255667019.180op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [55.006µs; 55.095µs] or [-0.081%; +0.081%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18151324.330op/s; 18180398.129op/s] or [-0.080%; +0.080%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.207µs; 52.217µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19150762.473op/s; 19154656.201op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.036µs; 6.039µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165578368.088op/s; 165664932.676op/s] or [-0.026%; +0.026%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 188.913ns 191.503ns ± 1.743ns 191.487ns ± 1.303ns 192.555ns 194.591ns 196.425ns 199.578ns 4.23% 1.072 1.874 0.91% 0.123ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [191.262ns; 191.745ns] or [-0.126%; +0.126%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.456µs 146.231µs ± 1.814µs 145.934µs ± 0.514µs 146.513µs 148.003µs 153.052µs 164.667µs 12.84% 6.315 55.206 1.24% 0.128µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [145.980µs; 146.483µs] or [-0.172%; +0.172%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc0b6bc 1772663778 remove-ref-protected-from-sts-policies
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.073ms 14.119ms ± 0.032ms 14.114ms ± 0.011ms 14.125ms 14.197ms 14.237ms 14.304ms 1.34% 2.832 10.476 0.22% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.115ms; 14.124ms] or [-0.031%; +0.031%] None None None

Baseline

Omitted due to size.

@dd-octo-sts
Copy link
Contributor

dd-octo-sts bot commented Mar 4, 2026

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 97.30 MB 97.30 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.51 MB 8.51 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 112.92 MB 112.92 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.12 MB 11.12 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 27.16 MB 27.16 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 76.26 KB 76.26 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 185.96 MB 185.97 MB +0% (+8.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 916.65 MB 916.65 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.93 MB 9.93 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 76.26 KB 76.26 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 24.76 MB 24.76 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 51.43 MB 51.43 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 22.97 MB 22.97 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 77.44 KB 77.44 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 190.13 MB 190.15 MB +0% (+16.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 900.31 MB 900.31 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.53 MB 7.53 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 77.44 KB 77.44 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 26.52 MB 26.52 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 47.06 MB 47.06 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 85.27 MB 85.27 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 10.04 MB 10.04 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 105.90 MB 105.90 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.79 MB 11.79 MB 0% (0 B) 👌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

ci-build

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@d-niu @codecov-commenter