Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test #923

Draft
wants to merge 4 commits into
base: main
Choose a base branch
from
Draft

Test #923

wants to merge 4 commits into from

Conversation

ganeshnj
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@pr-commenter
Copy link

pr-commenter bot commented Mar 13, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-03-14 10:51:14

Comparing candidate commit 17e62bc in PR branch ganeshnj/test/size-benchmark with baseline commit fc9530e in branch main.

Found 1 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.

scenario:benching deserializing traces from msgpack to their internal representation

  • 🟩 execution_time [-3.082ms; -2.986ms] or [-5.409%; -5.241%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17e62bc 1741948785 ganeshnj/test/size-benchmark
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.045µs 5.105µs ± 0.036µs 5.098µs ± 0.030µs 5.137µs 5.157µs 5.160µs 5.230µs 2.57% 0.376 -0.908 0.70% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.100µs; 5.110µs] or [-0.097%; +0.097%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17e62bc 1741948785 ganeshnj/test/size-benchmark
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 504.556µs 505.693µs ± 0.553µs 505.617µs ± 0.262µs 505.943µs 506.509µs 507.662µs 509.334µs 0.74% 2.090 10.307 0.11% 0.039µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1963349.715op/s 1977486.728op/s ± 2158.840op/s 1977781.058op/s ± 1023.211op/s 1978673.799op/s 1980285.444op/s 1981281.853op/s 1981939.685op/s 0.21% -2.064 10.117 0.11% 152.653op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 452.421µs 453.649µs ± 0.895µs 453.578µs ± 0.237µs 453.788µs 454.313µs 456.265µs 463.712µs 2.23% 7.937 81.752 0.20% 0.063µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2156511.868op/s 2204357.866op/s ± 4284.417op/s 2204692.468op/s ± 1154.162op/s 2205953.134op/s 2207467.961op/s 2209007.276op/s 2210329.666op/s 0.26% -7.815 79.826 0.19% 302.954op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 174.061µs 176.767µs ± 0.621µs 176.793µs ± 0.207µs 176.975µs 177.196µs 177.365µs 183.761µs 3.94% 6.679 80.533 0.35% 0.044µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5441843.877op/s 5657216.632op/s ± 19419.461op/s 5656333.720op/s ± 6644.622op/s 5664478.958op/s 5678676.771op/s 5686271.386op/s 5745126.031op/s 1.57% -6.283 75.779 0.34% 1373.163op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.570µs 37.678µs ± 0.052µs 37.667µs ± 0.034µs 37.715µs 37.778µs 37.805µs 37.819µs 0.40% 0.533 -0.226 0.14% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26441938.883op/s 26541080.846op/s ± 36766.364op/s 26548179.467op/s ± 24116.155op/s 26566975.636op/s 26595584.709op/s 26611794.590op/s 26616775.687op/s 0.26% -0.526 -0.233 0.14% 2599.775op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.228µs 48.330µs ± 0.045µs 48.328µs ± 0.028µs 48.358µs 48.400µs 48.443µs 48.556µs 0.47% 0.748 2.220 0.09% 0.003µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20594642.210op/s 20691135.973op/s ± 19456.811op/s 20692152.501op/s ± 11884.140op/s 20703686.544op/s 20720409.068op/s 20727461.446op/s 20734818.402op/s 0.21% -0.738 2.176 0.09% 1375.804op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [505.616µs; 505.770µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1977187.533op/s; 1977785.922op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [453.524µs; 453.773µs] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2203764.087op/s; 2204951.645op/s] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [176.681µs; 176.853µs] or [-0.049%; +0.049%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5654525.282op/s; 5659907.983op/s] or [-0.048%; +0.048%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.670µs; 37.685µs] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26535985.382op/s; 26546176.311op/s] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.324µs; 48.336µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20688439.446op/s; 20693832.500op/s] or [-0.013%; +0.013%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17e62bc 1741948785 ganeshnj/test/size-benchmark
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 5.933ms 5.945ms ± 0.007ms 5.944ms ± 0.003ms 5.947ms 5.953ms 5.981ms 5.990ms 0.78% 3.527 19.843 0.11% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [5.944ms; 5.946ms] or [-0.015%; +0.015%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17e62bc 1741948785 ganeshnj/test/size-benchmark
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.586µs 25.443µs ± 10.169µs 17.886µs ± 0.094µs 33.965µs 43.345µs 46.348µs 79.347µs 343.62% 1.437 3.361 39.87% 0.719µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.034µs; 26.852µs] or [-5.539%; +5.539%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17e62bc 1741948785 ganeshnj/test/size-benchmark
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.361µs 2.416µs ± 0.020µs 2.415µs ± 0.011µs 2.424µs 2.453µs 2.462µs 2.466µs 2.10% 0.149 0.510 0.82% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.413µs; 2.419µs] or [-0.114%; +0.114%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17e62bc 1741948785 ganeshnj/test/size-benchmark
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 69.344µs 69.588µs ± 0.215µs 69.565µs ± 0.045µs 69.619µs 69.674µs 70.023µs 72.197µs 3.78% 9.555 109.584 0.31% 0.015µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [69.558µs; 69.618µs] or [-0.043%; +0.043%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17e62bc 1741948785 ganeshnj/test/size-benchmark
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 208.563µs 209.057µs ± 0.181µs 209.048µs ± 0.118µs 209.171µs 209.384µs 209.423µs 209.510µs 0.22% 0.020 -0.139 0.09% 0.013µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4773045.024op/s 4783383.274op/s ± 4131.786op/s 4783601.495op/s ± 2692.938op/s 4786097.663op/s 4790090.612op/s 4792876.885op/s 4794717.500op/s 0.23% -0.015 -0.137 0.09% 292.161op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.212µs 18.312µs ± 0.045µs 18.312µs ± 0.031µs 18.341µs 18.382µs 18.403µs 18.470µs 0.86% 0.163 -0.123 0.25% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 54141334.361op/s 54609554.028op/s ± 134717.819op/s 54608185.150op/s ± 91163.585op/s 54713813.431op/s 54842602.997op/s 54856087.821op/s 54908471.270op/s 0.55% -0.149 -0.140 0.25% 9525.988op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.641µs 10.700µs ± 0.024µs 10.696µs ± 0.017µs 10.720µs 10.735µs 10.747µs 10.786µs 0.84% 0.159 0.040 0.22% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 92713238.666op/s 93456643.957op/s ± 210459.798op/s 93494945.351op/s ± 150246.728op/s 93600952.858op/s 93822350.393op/s 93895182.696op/s 93976673.544op/s 0.52% -0.146 0.025 0.22% 14881.755op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [209.032µs; 209.082µs] or [-0.012%; +0.012%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4782810.648op/s; 4783955.900op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.306µs; 18.318µs] or [-0.034%; +0.034%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54590883.433op/s; 54628224.622op/s] or [-0.034%; +0.034%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.697µs; 10.704µs] or [-0.031%; +0.031%] None None None
normalization/normalize_name/normalize_name/good throughput [93427476.253op/s; 93485811.660op/s] or [-0.031%; +0.031%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17e62bc 1741948785 ganeshnj/test/size-benchmark
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 35.044µs 35.593µs ± 0.904µs 35.156µs ± 0.070µs 35.374µs 37.503µs 37.550µs 38.842µs 10.48% 1.717 1.209 2.53% 0.064µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [35.468µs; 35.718µs] or [-0.352%; +0.352%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17e62bc 1741948785 ganeshnj/test/size-benchmark
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.896µs 3.914µs ± 0.003µs 3.914µs ± 0.001µs 3.916µs 3.919µs 3.920µs 3.921µs 0.17% -1.695 13.015 0.06% 0.000µs 1 200
credit_card/is_card_number/ throughput 255036190.874op/s 255462936.175op/s ± 164850.861op/s 255465066.954op/s ± 86407.383op/s 255551727.452op/s 255647629.385op/s 255844082.136op/s 256665437.607op/s 0.47% 1.718 13.204 0.06% 11656.716op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 81.729µs 82.373µs ± 0.284µs 82.335µs ± 0.104µs 82.483µs 82.676µs 82.910µs 85.311µs 3.61% 5.558 55.958 0.34% 0.020µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11721871.879op/s 12139980.549op/s ± 41044.596op/s 12145446.915op/s ± 15336.088op/s 12155318.266op/s 12190239.093op/s 12216864.747op/s 12235624.019op/s 0.74% -5.284 52.374 0.34% 2902.291op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 76.378µs 76.982µs ± 0.276µs 76.957µs ± 0.162µs 77.113µs 77.476µs 77.758µs 77.830µs 1.13% 0.666 0.527 0.36% 0.020µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12848582.030op/s 12990264.888op/s ± 46437.477op/s 12994271.479op/s ± 27412.472op/s 13023633.337op/s 13057480.864op/s 13075880.905op/s 13092710.794op/s 0.76% -0.644 0.488 0.36% 3283.625op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.895µs 3.914µs ± 0.003µs 3.914µs ± 0.001µs 3.916µs 3.918µs 3.920µs 3.921µs 0.18% -1.464 10.176 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255036216.640op/s 255479531.753op/s ± 181468.193op/s 255491313.299op/s ± 87285.711op/s 255570678.072op/s 255736009.842op/s 255906129.940op/s 256723982.933op/s 0.48% 1.485 10.331 0.07% 12831.739op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 73.042µs 74.021µs ± 0.458µs 74.011µs ± 0.307µs 74.265µs 74.870µs 75.034µs 75.529µs 2.05% 0.376 -0.035 0.62% 0.032µs 1 200
credit_card/is_card_number/378282246310005 throughput 13239921.600op/s 13510197.657op/s ± 83450.385op/s 13511441.495op/s ± 56003.883op/s 13569831.387op/s 13646373.185op/s 13685642.446op/s 13690688.010op/s 1.33% -0.343 -0.072 0.62% 5900.833op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.944µs 52.173µs ± 0.098µs 52.153µs ± 0.053µs 52.229µs 52.361µs 52.427µs 52.458µs 0.59% 0.658 0.251 0.19% 0.007µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19062863.665op/s 19166955.171op/s ± 35979.330op/s 19174524.727op/s ± 19592.622op/s 19190376.506op/s 19217054.679op/s 19234278.817op/s 19251513.199op/s 0.40% -0.647 0.239 0.19% 2544.123op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.428µs 6.561µs ± 0.075µs 6.555µs ± 0.051µs 6.609µs 6.691µs 6.722µs 6.777µs 3.39% 0.255 -0.487 1.14% 0.005µs 1 200
credit_card/is_card_number/x371413321323331 throughput 147554335.428op/s 152430323.772op/s ± 1738945.846op/s 152553065.888op/s ± 1171957.151op/s 153538358.489op/s 155292684.772op/s 155471444.358op/s 155564209.383op/s 1.97% -0.206 -0.534 1.14% 122962.040op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.890µs 3.915µs ± 0.006µs 3.914µs ± 0.001µs 3.916µs 3.919µs 3.920µs 3.981µs 1.72% 7.972 98.566 0.14% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 251180109.208op/s 255460965.831op/s ± 363134.105op/s 255487904.685op/s ± 88712.296op/s 255566431.349op/s 255779027.415op/s 255897714.811op/s 257045469.493op/s 0.61% -7.813 96.514 0.14% 25677.459op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 63.503µs 63.889µs ± 0.130µs 63.888µs ± 0.066µs 63.952µs 64.095µs 64.279µs 64.312µs 0.66% 0.072 1.588 0.20% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15549202.281op/s 15652315.475op/s ± 31833.701op/s 15652347.995op/s ± 16076.746op/s 15668631.009op/s 15703410.239op/s 15739635.782op/s 15747347.550op/s 0.61% -0.050 1.581 0.20% 2250.983op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.404µs 57.547µs ± 0.072µs 57.539µs ± 0.031µs 57.575µs 57.639µs 57.775µs 57.983µs 0.77% 2.443 12.349 0.12% 0.005µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17246458.232op/s 17377128.236op/s ± 21576.970op/s 17379592.014op/s ± 9233.926op/s 17388410.190op/s 17404895.214op/s 17413969.106op/s 17420538.815op/s 0.24% -2.412 12.129 0.12% 1525.722op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.896µs 3.914µs ± 0.003µs 3.914µs ± 0.002µs 3.916µs 3.919µs 3.921µs 3.927µs 0.33% -0.520 4.263 0.09% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254662054.188op/s 255506703.010op/s ± 218640.495op/s 255506331.379op/s ± 116759.616op/s 255611266.164op/s 255841178.921op/s 255950746.680op/s 256699211.694op/s 0.47% 0.535 4.316 0.09% 15460.218op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.576µs 54.820µs ± 0.242µs 54.697µs ± 0.054µs 55.028µs 55.211µs 55.567µs 55.628µs 1.70% 1.371 1.097 0.44% 0.017µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17976397.874op/s 18241866.273op/s ± 79935.182op/s 18282659.812op/s ± 18052.357op/s 18295665.761op/s 18310445.942op/s 18320361.471op/s 18323000.863op/s 0.22% -1.355 1.030 0.44% 5652.271op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.956µs 52.155µs ± 0.087µs 52.149µs ± 0.058µs 52.214µs 52.309µs 52.351µs 52.380µs 0.44% 0.251 -0.323 0.17% 0.006µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19091117.629op/s 19173692.102op/s ± 32129.416op/s 19175659.393op/s ± 21364.111op/s 19194542.032op/s 19225377.510op/s 19239612.870op/s 19246895.060op/s 0.37% -0.242 -0.327 0.17% 2271.893op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.431µs 6.564µs ± 0.084µs 6.556µs ± 0.064µs 6.629µs 6.720µs 6.763µs 6.806µs 3.82% 0.461 -0.346 1.27% 0.006µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 146930185.891op/s 152381875.585op/s ± 1934803.011op/s 152540024.120op/s ± 1497727.592op/s 153699663.154op/s 155315771.719op/s 155466366.283op/s 155507125.675op/s 1.95% -0.407 -0.428 1.27% 136811.233op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.914µs; 3.915µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ throughput [255440089.431op/s; 255485782.919op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [82.334µs; 82.413µs] or [-0.048%; +0.048%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12134292.163op/s; 12145668.935op/s] or [-0.047%; +0.047%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [76.943µs; 77.020µs] or [-0.050%; +0.050%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12983829.101op/s; 12996700.676op/s] or [-0.050%; +0.050%] None None None
credit_card/is_card_number/37828224631 execution_time [3.914µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255454382.006op/s; 255504681.499op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [73.957µs; 74.084µs] or [-0.086%; +0.086%] None None None
credit_card/is_card_number/378282246310005 throughput [13498632.237op/s; 13521763.078op/s] or [-0.086%; +0.086%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.160µs; 52.187µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19161968.782op/s; 19171941.560op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.551µs; 6.572µs] or [-0.159%; +0.159%] None None None
credit_card/is_card_number/x371413321323331 throughput [152189322.602op/s; 152671324.942op/s] or [-0.158%; +0.158%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.914µs; 3.915µs] or [-0.020%; +0.020%] None None None
credit_card/is_card_number_no_luhn/ throughput [255410638.936op/s; 255511292.725op/s] or [-0.020%; +0.020%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [63.871µs; 63.907µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15647903.630op/s; 15656727.319op/s] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [57.537µs; 57.557µs] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17374137.876op/s; 17380118.597op/s] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.913µs; 3.914µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255476401.540op/s; 255537004.480op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.787µs; 54.853µs] or [-0.061%; +0.061%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18230788.025op/s; 18252944.520op/s] or [-0.061%; +0.061%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.143µs; 52.167µs] or [-0.023%; +0.023%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19169239.274op/s; 19178144.930op/s] or [-0.023%; +0.023%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.552µs; 6.575µs] or [-0.177%; +0.177%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [152113730.496op/s; 152650020.674op/s] or [-0.176%; +0.176%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17e62bc 1741948785 ganeshnj/test/size-benchmark
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.177µs 3.193µs ± 1.429µs 2.986µs ± 0.027µs 3.014µs 3.673µs 13.864µs 14.908µs 399.26% 7.339 55.042 44.64% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.995µs; 3.391µs] or [-6.203%; +6.203%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17e62bc 1741948785 ganeshnj/test/size-benchmark
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 53.522ms 53.948ms ± 0.279ms 53.987ms ± 0.208ms 54.152ms 54.295ms 54.649ms 55.394ms 2.61% 0.755 2.301 0.52% 0.020ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [53.910ms; 53.987ms] or [-0.072%; +0.072%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17e62bc 1741948785 ganeshnj/test/size-benchmark
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 147.047µs 147.894µs ± 0.310µs 147.861µs ± 0.154µs 148.028µs 148.323µs 149.091µs 149.406µs 1.05% 1.397 5.647 0.21% 0.022µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [147.851µs; 147.937µs] or [-0.029%; +0.029%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17e62bc 1741948785 ganeshnj/test/size-benchmark
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 245.251ns 253.675ns ± 10.580ns 249.779ns ± 2.874ns 254.220ns 280.467ns 285.073ns 288.858ns 15.65% 1.872 2.211 4.16% 0.748ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.209ns; 255.141ns] or [-0.578%; +0.578%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Mar 13, 2025 •
edited
Loading

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 72.59%. Comparing base (9a4a791) to head (17e62bc).
Report is 1 commits behind head on main.

Additional details and impacted files 
@@            Coverage Diff             @@
##             main     #923      +/-   ##
==========================================
+ Coverage   72.44%   72.59%   +0.14%     
==========================================
  Files         333      334       +1     
  Lines       50097    50480     +383     
==========================================
+ Hits        36294    36644     +350     
- Misses      13803    13836      +33
Components Coverage Δ
crashtracker 42.90% <ø> (+0.02%) ⬆️
crashtracker-ffi 6.25% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 92.08% <ø> (ø)
data-pipeline-ffi 90.28% <ø> (ø)
ddcommon 79.19% <ø> (ø)
ddcommon-ffi 61.05% <ø> (ø)
ddtelemetry 61.74% <ø> (ø)
ddtelemetry-ffi 22.46% <ø> (ø)
dogstatsd 89.59% <ø> (ø)
dogstatsd-client 82.57% <ø> (ø)
ipc 82.40% <ø> (ø)
profiling 81.94% <ø> (ø)
profiling-ffi 70.68% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 40.63% <ø> (ø)
sidecar-ffi 3.23% <ø> (ø)
spawn-worker 54.37% <ø> (ø)
tinybytes 91.21% <ø> (ø)
trace-mini-agent 74.66% <ø> (ø)
trace-normalization 98.23% <ø> (ø)
trace-obfuscation 96.07% <ø> (ø)
trace-protobuf 78.13% <ø> (ø)
trace-utils 92.85% <ø> (-0.12%) ⬇️
🚀 New features to boost your workflow:
  • ❄ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@r1viollet
Copy link
Contributor

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 84.05 MB 84.05 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 26.56 MB 26.56 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.60 MB 8.60 MB 0% (0 B) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 47.32 MB 47.32 MB 0% (0 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 8.85 MB 8.85 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 8.53 MB 8.53 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 78.73 MB 78.73 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 25.22 MB 25.22 MB 0% (0 B) 👌
i686-alpine-linux-musl
Artifact Baseline Commit Change
/i686-alpine-linux-musl/lib/libdatadog_profiling.a 72.87 MB 72.87 MB 0% (0 B) 👌
/i686-alpine-linux-musl/lib/libdatadog_profiling.so 9.12 MB 9.12 MB 0% (0 B) 👌
/i686-alpine-linux-musl/lib/libdatadog_profiling.so.debug 25.76 MB 25.76 MB 0% (0 B) 👌
i686-unknown-linux-gnu
Artifact Baseline Commit Change
/i686-unknown-linux-gnu/lib/libdatadog_profiling.a 74.60 MB 74.60 MB 0% (0 B) 👌
/i686-unknown-linux-gnu/lib/libdatadog_profiling.so 9.01 MB 9.01 MB 0% (0 B) 👌
/i686-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 23.42 MB 23.42 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 19.17 MB 19.17 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 54.81 KB 54.81 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 133.08 MB 133.08 MB +0% (+8.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 860.13 MB 860.13 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 5.86 MB 5.86 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 54.81 KB 54.81 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 17.80 MB 17.80 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 30.05 MB 30.05 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 16.31 MB 16.31 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 55.66 KB 55.66 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 135.24 MB 135.24 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 850.34 MB 850.34 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.45 MB 4.45 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 55.66 KB 55.66 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 18.37 MB 18.37 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 27.59 MB 27.59 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 72.87 MB 72.87 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 9.12 MB 9.12 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 25.76 MB 25.76 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 47.32 MB 47.32 MB 0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 8.85 MB 8.85 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 74.60 MB 74.60 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.01 MB 9.01 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 23.42 MB 23.42 MB 0% (0 B) 👌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@ganeshnj @codecov-commenter @r1viollet