Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add span links and span events in the integration test #928

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

anais-raison
Copy link
Contributor

What does this PR do?

Add span_links and span_events in the integration test of the v04

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@pr-commenter
Copy link

pr-commenter bot commented Mar 14, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-03-14 16:56:46

Comparing candidate commit 931dfa4 in PR branch anais/add-span-fields-in-integration-test with baseline commit 78f2dfb in branch main.

Found 1 performance improvements and 1 performance regressions! Performance is the same for 50 metrics, 2 unstable metrics.

scenario:benching deserializing traces from msgpack to their internal representation

  • 🟩 execution_time [-2.460ms; -2.379ms] or [-4.317%; -4.174%]

scenario:redis/obfuscate_redis_string

  • 🟥 execution_time [+3.390µs; +3.797µs] or [+10.181%; +11.403%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 931dfa4 1741970718 anais/add-span-fields-in-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 36.293µs 36.896µs ± 1.058µs 36.413µs ± 0.056µs 36.503µs 39.166µs 39.298µs 40.139µs 10.23% 1.710 1.014 2.86% 0.075µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [36.749µs; 37.042µs] or [-0.397%; +0.397%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 931dfa4 1741970718 anais/add-span-fields-in-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 5.959ms 5.968ms ± 0.006ms 5.968ms ± 0.003ms 5.971ms 5.975ms 5.989ms 6.021ms 0.89% 4.163 30.760 0.10% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [5.968ms; 5.969ms] or [-0.014%; +0.014%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 931dfa4 1741970718 anais/add-span-fields-in-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 67.845µs 68.067µs ± 0.272µs 68.018µs ± 0.073µs 68.127µs 68.244µs 68.444µs 71.536µs 5.17% 10.468 130.238 0.40% 0.019µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [68.029µs; 68.105µs] or [-0.055%; +0.055%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 931dfa4 1741970718 anais/add-span-fields-in-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.361µs 2.433µs ± 0.020µs 2.438µs ± 0.009µs 2.443µs 2.457µs 2.463µs 2.489µs 2.09% -1.458 2.885 0.84% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.430µs; 2.435µs] or [-0.116%; +0.116%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 931dfa4 1741970718 anais/add-span-fields-in-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.894µs 3.914µs ± 0.003µs 3.914µs ± 0.001µs 3.916µs 3.918µs 3.922µs 3.923µs 0.22% -1.636 11.003 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 254899863.761op/s 255481389.331op/s ± 189795.568op/s 255469867.331op/s ± 76006.238op/s 255537966.563op/s 255805727.552op/s 255892231.881op/s 256798656.486op/s 0.52% 1.659 11.164 0.07% 13420.573op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 81.888µs 82.385µs ± 0.214µs 82.342µs ± 0.138µs 82.535µs 82.747µs 82.911µs 83.456µs 1.35% 0.835 2.433 0.26% 0.015µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11982420.807op/s 12138149.301op/s ± 31507.077op/s 12144431.334op/s ± 20435.457op/s 12157543.428op/s 12179460.638op/s 12204398.969op/s 12211748.924op/s 0.55% -0.806 2.316 0.26% 2227.887op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 76.697µs 77.419µs ± 0.340µs 77.409µs ± 0.227µs 77.614µs 78.008µs 78.274µs 78.433µs 1.32% 0.429 0.048 0.44% 0.024µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12749682.925op/s 12916981.328op/s ± 56693.446op/s 12918415.716op/s ± 37841.803op/s 12958231.130op/s 13004982.015op/s 13026334.286op/s 13038377.159op/s 0.93% -0.404 0.015 0.44% 4008.832op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.895µs 3.915µs ± 0.003µs 3.915µs ± 0.001µs 3.916µs 3.918µs 3.920µs 3.923µs 0.23% -1.924 15.476 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254876153.043op/s 255451317.073op/s ± 172851.088op/s 255455714.892op/s ± 89288.261op/s 255541506.110op/s 255676438.644op/s 255854707.083op/s 256762277.942op/s 0.51% 1.952 15.707 0.07% 12222.418op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 72.973µs 73.972µs ± 0.418µs 73.984µs ± 0.270µs 74.222µs 74.607µs 75.033µs 75.260µs 1.72% 0.164 0.179 0.56% 0.030µs 1 200
credit_card/is_card_number/378282246310005 throughput 13287311.038op/s 13519144.835op/s ± 76275.733op/s 13516468.923op/s ± 49530.623op/s 13569537.406op/s 13641400.217op/s 13693238.420op/s 13703664.108op/s 1.38% -0.128 0.148 0.56% 5393.509op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.920µs 52.153µs ± 0.093µs 52.149µs ± 0.054µs 52.201µs 52.324µs 52.420µs 52.488µs 0.65% 0.655 0.950 0.18% 0.007µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19051954.879op/s 19174318.181op/s ± 34023.671op/s 19176001.235op/s ± 19961.221op/s 19196196.281op/s 19222708.176op/s 19234421.090op/s 19260501.086op/s 0.44% -0.642 0.924 0.18% 2405.837op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.476µs 6.618µs ± 0.066µs 6.618µs ± 0.044µs 6.662µs 6.731µs 6.760µs 6.774µs 2.36% 0.023 -0.359 1.00% 0.005µs 1 200
credit_card/is_card_number/x371413321323331 throughput 147621106.347op/s 151121850.793op/s ± 1507928.716op/s 151105472.983op/s ± 1009025.069op/s 152085988.782op/s 153579480.519op/s 154413967.316op/s 154416070.123op/s 2.19% 0.026 -0.355 1.00% 106626.662op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.893µs 3.915µs ± 0.003µs 3.915µs ± 0.001µs 3.916µs 3.919µs 3.920µs 3.922µs 0.19% -2.105 15.415 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254982742.010op/s 255458920.134op/s ± 182726.982op/s 255457823.925op/s ± 92766.793op/s 255542541.447op/s 255727410.720op/s 255856192.845op/s 256846698.610op/s 0.54% 2.133 15.657 0.07% 12920.749op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 63.637µs 63.947µs ± 0.135µs 63.919µs ± 0.052µs 63.983µs 64.255µs 64.370µs 64.499µs 0.91% 1.262 2.473 0.21% 0.010µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15504116.343op/s 15637995.144op/s ± 32934.204op/s 15644852.677op/s ± 12776.215op/s 15655044.973op/s 15681308.352op/s 15699749.367op/s 15714010.612op/s 0.44% -1.244 2.427 0.21% 2328.800op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.415µs 57.545µs ± 0.099µs 57.527µs ± 0.027µs 57.554µs 57.879µs 57.908µs 57.935µs 0.71% 2.561 6.786 0.17% 0.007µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17260712.951op/s 17377703.765op/s ± 29714.001op/s 17383127.936op/s ± 8136.201op/s 17391178.760op/s 17408480.281op/s 17414639.062op/s 17417100.109op/s 0.20% -2.549 6.741 0.17% 2101.097op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.914µs ± 0.003µs 3.914µs ± 0.001µs 3.915µs 3.918µs 3.919µs 3.922µs 0.20% -1.500 8.592 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254993277.359op/s 255514557.681op/s ± 183390.773op/s 255510680.347op/s ± 93840.486op/s 255591731.911op/s 255837517.485op/s 255924564.077op/s 256721687.165op/s 0.47% 1.518 8.715 0.07% 12967.686op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.546µs 54.708µs ± 0.164µs 54.664µs ± 0.028µs 54.697µs 55.079µs 55.459µs 55.554µs 1.63% 3.246 11.200 0.30% 0.012µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 18000470.373op/s 18278944.971op/s ± 54344.094op/s 18293528.666op/s ± 9276.078op/s 18301148.400op/s 18320542.370op/s 18330210.423op/s 18333023.275op/s 0.22% -3.223 11.027 0.30% 3842.708op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.894µs 52.150µs ± 0.094µs 52.141µs ± 0.052µs 52.200µs 52.299µs 52.475µs 52.573µs 0.83% 0.880 3.055 0.18% 0.007µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19021238.402op/s 19175590.400op/s ± 34371.029op/s 19178762.398op/s ± 19096.082op/s 19197356.526op/s 19227606.917op/s 19245505.528op/s 19269932.512op/s 0.48% -0.857 2.979 0.18% 2430.399op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.437µs 6.578µs ± 0.072µs 6.561µs ± 0.045µs 6.626µs 6.713µs 6.756µs 6.794µs 3.55% 0.474 0.084 1.09% 0.005µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 147187033.797op/s 152049646.659op/s ± 1647484.881op/s 152405829.281op/s ± 1049839.007op/s 153281005.460op/s 154458431.085op/s 155317506.167op/s 155342029.024op/s 1.93% -0.414 0.008 1.08% 116494.773op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.914µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255455085.490op/s; 255507693.171op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [82.356µs; 82.415µs] or [-0.036%; +0.036%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12133782.723op/s; 12142515.879op/s] or [-0.036%; +0.036%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [77.372µs; 77.466µs] or [-0.061%; +0.061%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12909124.161op/s; 12924838.494op/s] or [-0.061%; +0.061%] None None None
credit_card/is_card_number/37828224631 execution_time [3.914µs; 3.915µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255427361.575op/s; 255475272.571op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [73.914µs; 74.029µs] or [-0.078%; +0.078%] None None None
credit_card/is_card_number/378282246310005 throughput [13508573.752op/s; 13529715.918op/s] or [-0.078%; +0.078%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.140µs; 52.166µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19169602.827op/s; 19179033.534op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.609µs; 6.627µs] or [-0.138%; +0.138%] None None None
credit_card/is_card_number/x371413321323331 throughput [150912866.375op/s; 151330835.210op/s] or [-0.138%; +0.138%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.914µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255433595.932op/s; 255484244.337op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [63.928µs; 63.966µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15633430.781op/s; 15642559.508op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [57.531µs; 57.559µs] or [-0.024%; +0.024%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17373585.690op/s; 17381821.840op/s] or [-0.024%; +0.024%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.913µs; 3.914µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255489141.484op/s; 255539973.879op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.685µs; 54.731µs] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18271413.402op/s; 18286476.540op/s] or [-0.041%; +0.041%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.137µs; 52.163µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19170826.906op/s; 19180353.894op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.568µs; 6.587µs] or [-0.151%; +0.151%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [151821321.099op/s; 152277972.219op/s] or [-0.150%; +0.150%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 931dfa4 1741970718 anais/add-span-fields-in-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 54.152ms 54.576ms ± 0.244ms 54.506ms ± 0.122ms 54.732ms 55.047ms 55.244ms 55.783ms 2.34% 1.300 2.827 0.45% 0.017ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [54.542ms; 54.610ms] or [-0.062%; +0.062%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 931dfa4 1741970718 anais/add-span-fields-in-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 244.898ns 254.290ns ± 10.946ns 249.642ns ± 2.281ns 253.755ns 281.056ns 287.979ns 288.827ns 15.70% 1.830 2.188 4.29% 0.774ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.773ns; 255.807ns] or [-0.597%; +0.597%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 931dfa4 1741970718 anais/add-span-fields-in-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.190µs 3.195µs ± 1.424µs 3.001µs ± 0.028µs 3.029µs 3.668µs 13.869µs 14.943µs 397.85% 7.386 55.594 44.45% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.998µs; 3.392µs] or [-6.175%; +6.175%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 931dfa4 1741970718 anais/add-span-fields-in-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 208.437µs 208.862µs ± 0.170µs 208.847µs ± 0.107µs 208.964µs 209.189µs 209.308µs 209.330µs 0.23% 0.394 0.165 0.08% 0.012µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4777148.035op/s 4787847.466op/s ± 3903.256op/s 4788202.508op/s ± 2451.262op/s 4790307.292op/s 4793600.322op/s 4796056.070op/s 4797618.462op/s 0.20% -0.389 0.161 0.08% 276.002op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.226µs 18.315µs ± 0.055µs 18.319µs ± 0.036µs 18.349µs 18.389µs 18.414µs 18.681µs 1.97% 1.303 7.873 0.30% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 53530060.053op/s 54599688.019op/s ± 164759.506op/s 54587093.367op/s ± 106049.379op/s 54727577.389op/s 54841369.611op/s 54845885.923op/s 54866016.266op/s 0.51% -1.230 7.320 0.30% 11650.256op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.650µs 10.711µs ± 0.028µs 10.712µs ± 0.018µs 10.728µs 10.752µs 10.784µs 10.804µs 0.86% 0.233 0.370 0.26% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 92554950.942op/s 93359695.156op/s ± 245624.387op/s 93355393.969op/s ± 154666.672op/s 93516366.447op/s 93785786.294op/s 93845439.333op/s 93895764.145op/s 0.58% -0.215 0.345 0.26% 17368.267op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [208.839µs; 208.886µs] or [-0.011%; +0.011%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4787306.512op/s; 4788388.419op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.308µs; 18.323µs] or [-0.042%; +0.042%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54576853.936op/s; 54622522.102op/s] or [-0.042%; +0.042%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.707µs; 10.715µs] or [-0.036%; +0.036%] None None None
normalization/normalize_name/normalize_name/good throughput [93325653.979op/s; 93393736.334op/s] or [-0.036%; +0.036%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 931dfa4 1741970718 anais/add-span-fields-in-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 147.516µs 148.503µs ± 0.362µs 148.473µs ± 0.216µs 148.731µs 149.021µs 149.778µs 150.156µs 1.13% 1.049 2.951 0.24% 0.026µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [148.452µs; 148.553µs] or [-0.034%; +0.034%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 931dfa4 1741970718 anais/add-span-fields-in-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 504.303µs 505.712µs ± 0.596µs 505.671µs ± 0.281µs 505.967µs 506.401µs 506.891µs 511.503µs 1.15% 4.618 43.088 0.12% 0.042µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1955022.110op/s 1977412.740op/s ± 2316.089op/s 1977569.419op/s ± 1097.837op/s 1978589.844op/s 1980068.880op/s 1981095.583op/s 1982935.518op/s 0.27% -4.535 42.053 0.12% 163.772op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 452.619µs 453.483µs ± 0.334µs 453.454µs ± 0.201µs 453.666µs 454.008µs 454.247µs 454.615µs 0.26% 0.172 0.083 0.07% 0.024µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2199664.661op/s 2205156.448op/s ± 1626.229op/s 2205295.112op/s ± 975.695op/s 2206159.116op/s 2207849.137op/s 2208600.880op/s 2209362.749op/s 0.18% -0.167 0.079 0.07% 114.992op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 175.443µs 176.689µs ± 0.373µs 176.724µs ± 0.243µs 176.921µs 177.191µs 177.364µs 178.678µs 1.11% 0.342 3.424 0.21% 0.026µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5596655.439op/s 5659692.110op/s ± 11937.675op/s 5658529.567op/s ± 7806.226op/s 5667527.842op/s 5678836.717op/s 5687958.740op/s 5699843.010op/s 0.73% -0.308 3.294 0.21% 844.121op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.570µs 37.707µs ± 0.050µs 37.709µs ± 0.030µs 37.736µs 37.791µs 37.836µs 37.846µs 0.36% 0.089 0.204 0.13% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26422973.116op/s 26520400.908op/s ± 34931.936op/s 26518874.311op/s ± 21200.321op/s 26543289.757op/s 26575109.673op/s 26599565.625op/s 26617101.085op/s 0.37% -0.080 0.201 0.13% 2470.061op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.088µs 48.328µs ± 0.216µs 48.311µs ± 0.211µs 48.541µs 48.630µs 48.672µs 48.710µs 0.83% 0.140 -1.687 0.45% 0.015µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20529614.420op/s 20692192.231op/s ± 92473.556op/s 20699266.738op/s ± 90633.308op/s 20788727.758op/s 20792534.411op/s 20794008.521op/s 20795218.288op/s 0.46% -0.136 -1.690 0.45% 6538.868op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [505.629µs; 505.795µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1977091.752op/s; 1977733.727op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [453.436µs; 453.529µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2204931.068op/s; 2205381.827op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [176.637µs; 176.741µs] or [-0.029%; +0.029%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5658037.663op/s; 5661346.557op/s] or [-0.029%; +0.029%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.700µs; 37.714µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26515559.677op/s; 26525242.138op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.298µs; 48.358µs] or [-0.062%; +0.062%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20679376.286op/s; 20705008.177op/s] or [-0.062%; +0.062%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 931dfa4 1741970718 anais/add-span-fields-in-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.971µs 5.048µs ± 0.041µs 5.049µs ± 0.038µs 5.074µs 5.122µs 5.124µs 5.125µs 1.51% 0.255 -0.998 0.82% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.042µs; 5.053µs] or [-0.114%; +0.114%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 931dfa4 1741970718 anais/add-span-fields-in-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.919µs 26.030µs ± 10.831µs 18.100µs ± 0.129µs 34.365µs 44.902µs 46.317µs 90.979µs 402.65% 1.829 6.525 41.51% 0.766µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.528µs; 27.531µs] or [-5.767%; +5.767%] None None None

Baseline

Omitted due to size.

ekump
ekump previously approved these changes Mar 14, 2025
@ekump ekump dismissed their stale review March 14, 2025 17:35

approved by mistake

Copy link
Contributor

@ekump ekump left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You should also update integration tests for data-pipeline (they're almost the same) https://github.com/DataDog/libdatadog/tree/b39c6ee17c99ae4ce1d5cf4e6ac0db96ef27576d/data-pipeline/tests

@r1viollet
Copy link
Contributor

r1viollet commented Mar 14, 2025

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.60 MB 8.60 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 26.67 MB 26.67 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 84.33 MB 84.33 MB 0% (0 B) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 47.49 MB 47.49 MB 0% (0 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 8.88 MB 8.88 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 8.54 MB 8.54 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 78.97 MB 78.97 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 25.33 MB 25.33 MB 0% (0 B) 👌
i686-alpine-linux-musl
Artifact Baseline Commit Change
/i686-alpine-linux-musl/lib/libdatadog_profiling.a 73.11 MB 73.11 MB 0% (0 B) 👌
/i686-alpine-linux-musl/lib/libdatadog_profiling.so 9.15 MB 9.15 MB 0% (0 B) 👌
/i686-alpine-linux-musl/lib/libdatadog_profiling.so.debug 25.86 MB 25.86 MB 0% (0 B) 👌
i686-unknown-linux-gnu
Artifact Baseline Commit Change
/i686-unknown-linux-gnu/lib/libdatadog_profiling.a 74.81 MB 74.81 MB 0% (0 B) 👌
/i686-unknown-linux-gnu/lib/libdatadog_profiling.so 9.03 MB 9.03 MB 0% (0 B) 👌
/i686-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 23.52 MB 23.52 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 19.25 MB 19.25 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 54.81 KB 54.81 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 133.67 MB 133.68 MB +0% (+8.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 861.90 MB 861.90 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 5.88 MB 5.88 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 54.81 KB 54.81 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 17.86 MB 17.86 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 30.16 MB 30.16 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 16.39 MB 16.39 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 55.66 KB 55.66 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 135.87 MB 135.85 MB --.01% (-16.00 KB) 💪
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 852.12 MB 852.12 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.47 MB 4.47 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 55.66 KB 55.66 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 18.43 MB 18.43 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 27.69 MB 27.69 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 73.11 MB 73.11 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 9.15 MB 9.15 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 25.86 MB 25.86 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 47.49 MB 47.49 MB 0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 8.88 MB 8.88 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 74.81 MB 74.81 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.03 MB 9.03 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 23.52 MB 23.52 MB 0% (0 B) 👌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants