chore(ci): cargo test --doc in an independent workflow

[iunanua]

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

[codecov-commenter]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.20%. Comparing base (8fb3175) to head (a722b5f).
⚠️ Report is 3 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1648      +/-   ##
==========================================
+ Coverage   71.19%   71.20%   +0.01%     
==========================================
  Files         425      425              
  Lines       62666    62715      +49     
==========================================
+ Hits        44615    44658      +43     
- Misses      18051    18057       +6     

Components	Coverage Δ
libdd-crashtracker	62.90% <ø> (-0.16%)	⬇️
libdd-crashtracker-ffi	15.63% <ø> (ø)
libdd-alloc	98.77% <ø> (ø)
libdd-data-pipeline	87.38% <ø> (ø)
libdd-data-pipeline-ffi	72.83% <ø> (ø)
libdd-common	79.73% <ø> (ø)
libdd-common-ffi	73.40% <ø> (ø)
libdd-telemetry	62.48% <ø> (ø)
libdd-telemetry-ffi	16.75% <ø> (ø)
libdd-dogstatsd-client	82.64% <ø> (ø)
datadog-ipc	80.74% <ø> (ø)
libdd-profiling	81.60% <ø> (ø)
libdd-profiling-ffi	63.65% <ø> (ø)
datadog-sidecar	33.45% <ø> (ø)
datdog-sidecar-ffi	12.41% <ø> (ø)
spawn-worker	54.69% <ø> (ø)
libdd-tinybytes	93.16% <ø> (ø)
libdd-trace-normalization	81.71% <ø> (ø)
libdd-trace-obfuscation	94.67% <ø> (ø)
libdd-trace-protobuf	68.00% <ø> (ø)
libdd-trace-utils	88.97% <ø> (ø)
datadog-tracer-flare	90.45% <ø> (ø)
libdd-log	74.69% <ø> (ø)

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[pr-commenter]

Benchmarks

Comparison

Benchmark execution time: 2026-03-05 08:21:07

Comparing candidate commit a722b5f in PR branch igor/ci/test-doc with baseline commit f79e281 in branch main.

Found 1 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 2 unstable metrics.

scenario:profile_add_sample2_frames_x1000

• 🟩 execution_time [-52.716µs; -52.317µs] or [-6.868%; -6.816%]

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	534.205µs	535.107µs ± 0.947µs	534.991µs ± 0.220µs	535.216µs	535.880µs	537.255µs	546.540µs	2.16%	9.091	104.784	0.18%	0.067µs	1	200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	1829692.640op/s	1868790.471op/s ± 3256.630op/s	1869189.604op/s ± 769.978op/s	1869943.401op/s	1871230.245op/s	1871611.478op/s	1871940.959op/s	0.15%	-8.964	102.622	0.17%	230.279op/s	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	380.715µs	381.782µs ± 0.419µs	381.720µs ± 0.274µs	382.065µs	382.515µs	382.762µs	382.897µs	0.31%	0.259	-0.202	0.11%	0.030µs	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	2611671.674op/s	2619299.588op/s ± 2872.702op/s	2619723.201op/s ± 1879.273op/s	2621231.680op/s	2623950.457op/s	2625167.818op/s	2626635.523op/s	0.26%	-0.253	-0.204	0.11%	203.131op/s	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	190.020µs	190.385µs ± 0.218µs	190.369µs ± 0.091µs	190.455µs	190.695µs	190.877µs	191.961µs	0.84%	3.679	23.641	0.11%	0.015µs	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	5209386.620op/s	5252517.917op/s ± 5995.289op/s	5252969.191op/s ± 2524.155op/s	5255633.863op/s	5259323.061op/s	5261665.286op/s	5262593.285op/s	0.18%	-3.637	23.264	0.11%	423.931op/s	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	37.372µs	37.519µs ± 0.058µs	37.522µs ± 0.038µs	37.554µs	37.618µs	37.653µs	37.666µs	0.38%	0.151	-0.072	0.15%	0.004µs	1	200
normalization/normalize_service/normalize_service/[empty string]	throughput	26549385.808op/s	26653017.943op/s ± 40991.093op/s	26651177.260op/s ± 27225.798op/s	26682647.667op/s	26717363.080op/s	26749408.668op/s	26758145.546op/s	0.40%	-0.142	-0.073	0.15%	2898.508op/s	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	45.757µs	45.910µs ± 0.126µs	45.895µs ± 0.035µs	45.933µs	46.014µs	46.100µs	47.501µs	3.50%	10.181	125.593	0.27%	0.009µs	1	200
normalization/normalize_service/normalize_service/test_ASCII	throughput	21052040.644op/s	21782092.239op/s ± 58195.718op/s	21788900.177op/s ± 16643.305op/s	21803068.989op/s	21820864.597op/s	21832599.286op/s	21854712.301op/s	0.30%	-9.985	122.246	0.27%	4115.059op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[534.976µs; 535.238µs] or [-0.025%; +0.025%]	None	None	None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	[1868339.133op/s; 1869241.808op/s] or [-0.024%; +0.024%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[381.724µs; 381.840µs] or [-0.015%; +0.015%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	[2618901.459op/s; 2619697.717op/s] or [-0.015%; +0.015%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[190.355µs; 190.415µs] or [-0.016%; +0.016%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	[5251687.027op/s; 5253348.806op/s] or [-0.016%; +0.016%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[37.511µs; 37.527µs] or [-0.021%; +0.021%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	throughput	[26647336.972op/s; 26658698.914op/s] or [-0.021%; +0.021%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[45.892µs; 45.927µs] or [-0.038%; +0.038%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	throughput	[21774026.872op/s; 21790157.605op/s] or [-0.037%; +0.037%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
receiver_entry_point/report/2597	execution_time	3.113ms	3.137ms ± 0.010ms	3.135ms ± 0.005ms	3.141ms	3.155ms	3.166ms	3.190ms	1.74%	1.286	4.025	0.33%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
receiver_entry_point/report/2597	execution_time	[3.135ms; 3.138ms] or [-0.046%; +0.046%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.322µs	2.391µs ± 0.020µs	2.391µs ± 0.007µs	2.400µs	2.420µs	2.436µs	2.439µs	1.98%	-1.197	3.504	0.83%	0.001µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.389µs; 2.394µs] or [-0.115%; +0.115%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	161.361µs	162.404µs ± 0.348µs	162.358µs ± 0.136µs	162.494µs	162.889µs	163.386µs	165.260µs	1.79%	3.554	24.468	0.21%	0.025µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[162.355µs; 162.452µs] or [-0.030%; +0.030%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
ip_address/quantize_peer_ip_address_benchmark	execution_time	4.923µs	4.992µs ± 0.051µs	4.964µs ± 0.015µs	5.035µs	5.074µs	5.075µs	5.077µs	2.27%	0.617	-1.323	1.01%	0.004µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark	execution_time	[4.985µs; 4.999µs] or [-0.141%; +0.141%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
single_flag_killswitch/rules-based	execution_time	188.894ns	191.629ns ± 2.042ns	191.382ns ± 1.560ns	192.865ns	194.899ns	198.455ns	199.263ns	4.12%	0.992	1.221	1.06%	0.144ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
single_flag_killswitch/rules-based	execution_time	[191.346ns; 191.912ns] or [-0.148%; +0.148%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	34.091µs	34.681µs ± 0.993µs	34.262µs ± 0.098µs	34.338µs	36.794µs	36.851µs	37.858µs	10.50%	1.705	1.038	2.85%	0.070µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[34.544µs; 34.819µs] or [-0.397%; +0.397%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
concentrator/add_spans_to_concentrator	execution_time	10.554ms	10.585ms ± 0.016ms	10.585ms ± 0.009ms	10.594ms	10.608ms	10.624ms	10.696ms	1.06%	1.913	11.798	0.15%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
concentrator/add_spans_to_concentrator	execution_time	[10.583ms; 10.587ms] or [-0.020%; +0.020%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sdk_test_data/rules-based	execution_time	144.472µs	146.536µs ± 1.646µs	146.278µs ± 0.491µs	146.816µs	147.931µs	151.898µs	162.321µs	10.97%	5.724	46.231	1.12%	0.116µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sdk_test_data/rules-based	execution_time	[146.308µs; 146.764µs] or [-0.156%; +0.156%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
profile_add_sample2_frames_x1000	execution_time	713.457µs	715.015µs ± 0.804µs	714.888µs ± 0.507µs	715.512µs	716.556µs	717.225µs	717.732µs	0.40%	0.609	0.443	0.11%	0.057µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
profile_add_sample2_frames_x1000	execution_time	[714.904µs; 715.127µs] or [-0.016%; +0.016%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching serializing traces from their internal representation to msgpack	execution_time	13.995ms	14.044ms ± 0.031ms	14.038ms ± 0.011ms	14.051ms	14.114ms	14.155ms	14.207ms	1.21%	2.420	7.803	0.22%	0.002ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching serializing traces from their internal representation to msgpack	execution_time	[14.040ms; 14.048ms] or [-0.031%; +0.031%]	None	None	None

Group 12

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	89.331µs	89.736µs ± 0.247µs	89.710µs ± 0.048µs	89.765µs	89.893µs	90.016µs	92.942µs	3.60%	11.036	141.088	0.27%	0.017µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[89.702µs; 89.771µs] or [-0.038%; +0.038%]	None	None	None

Group 13

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	47.930ms	48.283ms ± 1.536ms	48.075ms ± 0.052ms	48.141ms	48.361ms	50.992ms	65.492ms	36.23%	9.720	97.442	3.17%	0.109ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[48.070ms; 48.496ms] or [-0.441%; +0.441%]	None	None	None

Group 14

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
profile_add_sample_frames_x1000	execution_time	4.163ms	4.168ms ± 0.006ms	4.167ms ± 0.002ms	4.169ms	4.173ms	4.176ms	4.243ms	1.81%	9.901	119.533	0.14%	0.000ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
profile_add_sample_frames_x1000	execution_time	[4.167ms; 4.169ms] or [-0.020%; +0.020%]	None	None	None

Group 15

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	185.246µs	185.656µs ± 0.211µs	185.606µs ± 0.140µs	185.810µs	186.057µs	186.193µs	186.438µs	0.45%	0.702	0.151	0.11%	0.015µs	1	200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	5363716.357op/s	5386324.704op/s ± 6122.995op/s	5387751.279op/s ± 4067.999op/s	5390949.405op/s	5394361.991op/s	5394994.474op/s	5398218.256op/s	0.19%	-0.696	0.137	0.11%	432.961op/s	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	17.898µs	17.989µs ± 0.042µs	17.986µs ± 0.027µs	18.013µs	18.067µs	18.093µs	18.112µs	0.70%	0.396	-0.110	0.23%	0.003µs	1	200
normalization/normalize_name/normalize_name/bad-name	throughput	55210502.801op/s	55590115.584op/s ± 130440.076op/s	55598591.260op/s ± 84213.285op/s	55683937.998op/s	55783579.400op/s	55848229.742op/s	55872767.848op/s	0.49%	-0.384	-0.122	0.23%	9223.506op/s	1	200
normalization/normalize_name/normalize_name/good	execution_time	10.299µs	10.424µs ± 0.060µs	10.415µs ± 0.039µs	10.457µs	10.543µs	10.566µs	10.581µs	1.60%	0.518	-0.165	0.57%	0.004µs	1	200
normalization/normalize_name/normalize_name/good	throughput	94506319.036op/s	95939718.151op/s ± 549750.091op/s	96015537.075op/s ± 354817.007op/s	96333542.992op/s	96721100.092op/s	97007562.977op/s	97099662.505op/s	1.13%	-0.491	-0.192	0.57%	38873.202op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[185.626µs; 185.685µs] or [-0.016%; +0.016%]	None	None	None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	[5385476.116op/s; 5387173.293op/s] or [-0.016%; +0.016%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[17.983µs; 17.995µs] or [-0.033%; +0.033%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	throughput	[55572037.844op/s; 55608193.324op/s] or [-0.033%; +0.033%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[10.415µs; 10.432µs] or [-0.080%; +0.080%]	None	None	None
normalization/normalize_name/normalize_name/good	throughput	[95863528.076op/s; 96015908.226op/s] or [-0.079%; +0.079%]	None	None	None

Group 16

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	18.209µs	26.725µs ± 10.151µs	18.461µs ± 0.222µs	35.362µs	44.828µs	46.375µs	68.800µs	272.67%	0.893	0.461	37.89%	0.718µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[25.318µs; 28.132µs] or [-5.264%; +5.264%]	None	None	None

Group 17

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	1.233µs	3.209µs ± 1.433µs	2.992µs ± 0.034µs	3.021µs	3.669µs	14.056µs	14.799µs	394.55%	7.326	54.905	44.54%	0.101µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[3.010µs; 3.407µs] or [-6.189%; +6.189%]	None	None	None

Group 18

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	239.382ns	249.435ns ± 13.031ns	243.561ns ± 1.832ns	248.274ns	277.982ns	289.763ns	292.156ns	19.95%	1.871	2.197	5.21%	0.921ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[247.629ns; 251.241ns] or [-0.724%; +0.724%]	None	None	None

Group 19

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	a722b5f	1772697851	igor/ci/test-doc

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	3.896µs	3.911µs ± 0.002µs	3.911µs ± 0.001µs	3.912µs	3.915µs	3.917µs	3.928µs	0.43%	0.605	18.110	0.06%	0.000µs	1	200
credit_card/is_card_number/	throughput	254572317.013op/s	255665769.567op/s ± 156891.811op/s	255669797.855op/s ± 67379.568op/s	255739518.695op/s	255874135.873op/s	255940061.945op/s	256656140.016op/s	0.39%	-0.568	18.057	0.06%	11093.926op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	78.898µs	79.678µs ± 0.434µs	79.642µs ± 0.326µs	79.971µs	80.419µs	80.849µs	81.451µs	2.27%	0.714	0.961	0.54%	0.031µs	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	12277314.125op/s	12550920.692op/s ± 68160.571op/s	12556212.719op/s ± 51175.968op/s	12605249.512op/s	12650589.680op/s	12661966.033op/s	12674601.437op/s	0.94%	-0.675	0.836	0.54%	4819.680op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	72.319µs	72.930µs ± 0.359µs	72.889µs ± 0.245µs	73.140µs	73.619µs	73.949µs	74.148µs	1.73%	0.735	0.422	0.49%	0.025µs	1	200
credit_card/is_card_number/ 378282246310005	throughput	13486612.924op/s	13712153.205op/s ± 67267.079op/s	13719473.550op/s ± 46172.217op/s	13763569.214op/s	13807341.088op/s	13823326.056op/s	13827613.745op/s	0.79%	-0.707	0.358	0.49%	4756.501op/s	1	200
credit_card/is_card_number/37828224631	execution_time	3.893µs	3.912µs ± 0.003µs	3.912µs ± 0.001µs	3.913µs	3.916µs	3.918µs	3.926µs	0.36%	-0.930	15.777	0.07%	0.000µs	1	200
credit_card/is_card_number/37828224631	throughput	254707428.757op/s	255616024.881op/s ± 175972.258op/s	255633206.756op/s ± 87476.354op/s	255707857.578op/s	255812004.200op/s	255885724.309op/s	256896944.223op/s	0.49%	0.965	15.951	0.07%	12443.118op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	69.205µs	69.700µs ± 0.341µs	69.667µs ± 0.272µs	69.952µs	70.271µs	70.649µs	70.799µs	1.62%	0.602	-0.230	0.49%	0.024µs	1	200
credit_card/is_card_number/378282246310005	throughput	14124472.502op/s	14347454.950op/s ± 70015.562op/s	14353978.995op/s ± 56157.860op/s	14407913.189op/s	14436546.322op/s	14447190.319op/s	14449811.390op/s	0.67%	-0.582	-0.279	0.49%	4950.848op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	52.153µs	52.209µs ± 0.031µs	52.202µs ± 0.018µs	52.229µs	52.264µs	52.296µs	52.319µs	0.22%	0.899	0.787	0.06%	0.002µs	1	200
credit_card/is_card_number/37828224631000521389798	throughput	19113627.429op/s	19153922.491op/s ± 11229.146op/s	19156338.873op/s ± 6680.333op/s	19161672.344op/s	19168977.693op/s	19171472.239op/s	19174476.854op/s	0.09%	-0.896	0.777	0.06%	794.021op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	6.028µs	6.038µs ± 0.009µs	6.035µs ± 0.002µs	6.038µs	6.070µs	6.074µs	6.081µs	0.75%	2.981	8.593	0.16%	0.001µs	1	200
credit_card/is_card_number/x371413321323331	throughput	164455428.455op/s	165629171.886op/s ± 257865.467op/s	165695661.728op/s ± 63975.881op/s	165752930.685op/s	165824990.449op/s	165875302.659op/s	165888178.337op/s	0.12%	-2.973	8.552	0.16%	18233.842op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	3.892µs	3.912µs ± 0.003µs	3.912µs ± 0.001µs	3.914µs	3.916µs	3.921µs	3.923µs	0.27%	-1.201	15.762	0.07%	0.000µs	1	200
credit_card/is_card_number_no_luhn/	throughput	254925434.560op/s	255606406.541op/s ± 178698.666op/s	255619134.887op/s ± 93109.780op/s	255702435.566op/s	255805272.830op/s	255869892.751op/s	256938985.482op/s	0.52%	1.235	15.989	0.07%	12635.904op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	64.034µs	64.407µs ± 0.154µs	64.391µs ± 0.092µs	64.489µs	64.677µs	64.829µs	64.921µs	0.82%	0.587	0.787	0.24%	0.011µs	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	15403377.427op/s	15526371.349op/s ± 36956.320op/s	15530097.481op/s ± 22162.639op/s	15550968.186op/s	15583886.575op/s	15605184.401op/s	15616658.289op/s	0.56%	-0.569	0.763	0.24%	2613.206op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	58.129µs	58.375µs ± 0.148µs	58.352µs ± 0.079µs	58.429µs	58.697µs	58.799µs	58.946µs	1.02%	1.135	1.364	0.25%	0.010µs	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	16964731.408op/s	17130702.639op/s ± 43269.485op/s	17137397.102op/s ± 23182.473op/s	17160653.625op/s	17184973.030op/s	17198644.123op/s	17203220.443op/s	0.38%	-1.119	1.317	0.25%	3059.615op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	3.894µs	3.911µs ± 0.002µs	3.911µs ± 0.001µs	3.912µs	3.915µs	3.917µs	3.923µs	0.31%	-0.835	14.603	0.06%	0.000µs	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	254884217.573op/s	255670320.294op/s ± 160234.111op/s	255676963.506op/s ± 72133.043op/s	255741992.847op/s	255869138.487op/s	255949402.730op/s	256812073.321op/s	0.44%	0.865	14.750	0.06%	11330.263op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	54.570µs	54.894µs ± 0.233µs	54.845µs ± 0.187µs	55.061µs	55.340µs	55.447µs	55.551µs	1.29%	0.631	-0.497	0.42%	0.016µs	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	18001608.931op/s	18217374.298op/s ± 77102.443op/s	18233367.095op/s ± 62147.727op/s	18286203.547op/s	18310432.762op/s	18320768.663op/s	18325136.590op/s	0.50%	-0.617	-0.525	0.42%	5451.966op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	52.150µs	52.204µs ± 0.031µs	52.199µs ± 0.015µs	52.215µs	52.253µs	52.322µs	52.362µs	0.31%	1.706	4.935	0.06%	0.002µs	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	19097670.860op/s	19155804.974op/s ± 11408.974op/s	19157601.355op/s ± 5357.604op/s	19162785.870op/s	19169618.646op/s	19173438.308op/s	19175463.077op/s	0.09%	-1.699	4.898	0.06%	806.736op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	6.027µs	6.036µs ± 0.010µs	6.034µs ± 0.002µs	6.037µs	6.041µs	6.080µs	6.108µs	1.22%	4.620	24.274	0.16%	0.001µs	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	163724564.890op/s	165663600.111op/s ± 266327.749op/s	165720052.126op/s ± 52771.414op/s	165764163.163op/s	165845914.553op/s	165881282.532op/s	165909792.933op/s	0.11%	-4.596	24.023	0.16%	18832.216op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[3.911µs; 3.912µs] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number/	throughput	[255644025.871op/s; 255687513.263op/s] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[79.618µs; 79.738µs] or [-0.076%; +0.076%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[12541474.293op/s; 12560367.092op/s] or [-0.075%; +0.075%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[72.880µs; 72.980µs] or [-0.068%; +0.068%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[13702830.635op/s; 13721475.775op/s] or [-0.068%; +0.068%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[3.912µs; 3.912µs] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[255591636.818op/s; 255640412.943op/s] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[69.653µs; 69.748µs] or [-0.068%; +0.068%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[14337751.467op/s; 14357158.434op/s] or [-0.068%; +0.068%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[52.204µs; 52.213µs] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[19152366.239op/s; 19155478.742op/s] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[6.036µs; 6.039µs] or [-0.022%; +0.022%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[165593434.212op/s; 165664909.560op/s] or [-0.022%; +0.022%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[3.912µs; 3.913µs] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[255581640.624op/s; 255631172.457op/s] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[64.386µs; 64.428µs] or [-0.033%; +0.033%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[15521249.558op/s; 15531493.140op/s] or [-0.033%; +0.033%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[58.355µs; 58.396µs] or [-0.035%; +0.035%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[17124705.904op/s; 17136699.373op/s] or [-0.035%; +0.035%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[3.911µs; 3.912µs] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[255648113.387op/s; 255692527.201op/s] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[54.861µs; 54.926µs] or [-0.059%; +0.059%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[18206688.641op/s; 18228059.955op/s] or [-0.059%; +0.059%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[52.199µs; 52.208µs] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[19154223.800op/s; 19157386.148op/s] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[6.035µs; 6.038µs] or [-0.022%; +0.022%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[165626689.647op/s; 165700510.576op/s] or [-0.022%; +0.022%]	None	None	None

Baseline

Omitted due to size.

[dd-octo-sts]

Artifact Size Benchmark Report

aarch64-alpine-linux-musl

Artifact	Baseline	Commit	Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so	8.51 MB	8.51 MB	0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a	97.30 MB	97.30 MB	0% (0 B) 👌

aarch64-unknown-linux-gnu

Artifact	Baseline	Commit	Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a	112.92 MB	112.92 MB	0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so	11.12 MB	11.12 MB	0% (0 B) 👌

libdatadog-x64-windows

Artifact	Baseline	Commit	Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll	27.16 MB	27.16 MB	0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib	76.26 KB	76.26 KB	0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb	185.98 MB	185.96 MB	-0% (-16.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib	916.65 MB	916.65 MB	0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll	9.93 MB	9.93 MB	0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib	76.26 KB	76.26 KB	0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb	24.76 MB	24.76 MB	0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib	51.43 MB	51.43 MB	0% (0 B) 👌

libdatadog-x86-windows

Artifact	Baseline	Commit	Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll	22.97 MB	22.97 MB	0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib	77.44 KB	77.44 KB	0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb	190.16 MB	190.16 MB	0% (0 B) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib	900.31 MB	900.31 MB	0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll	7.53 MB	7.53 MB	0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib	77.44 KB	77.44 KB	0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb	26.52 MB	26.52 MB	0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib	47.06 MB	47.06 MB	0% (0 B) 👌

x86_64-alpine-linux-musl

Artifact	Baseline	Commit	Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a	85.27 MB	85.27 MB	0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so	10.04 MB	10.04 MB	0% (0 B) 👌

x86_64-unknown-linux-gnu

Artifact	Baseline	Commit	Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a	105.90 MB	105.90 MB	0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so	11.79 MB	11.79 MB	0% (0 B) 👌