Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SVLS-3545] Add Serverless metric origins to dogstatsd package #876

Open
wants to merge 39 commits into
base: main
Choose a base branch
from

Conversation

DylanLovesCoffee
Copy link

What does this PR do?

Adds metric origins for Serverless. This will effect the Lambda Extension and Serverless Compatibility Layer.

Currently all metrics (custom and standard) are bucketed into the serverless origin product. At the moment, we just want to be able to differentiate custom metrics by their source. Reference this mapping for Serverless metric origin designations.

Motivation

SVLS-3545 - correct Serverless metric origins

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Copy the git hash to your Cargo.toml

@DylanLovesCoffee DylanLovesCoffee requested review from a team February 12, 2025 20:49
@duncanpharvey
Copy link
Contributor

Can we get Azure Functions in on this?

@codecov-commenter
Copy link

codecov-commenter commented Feb 12, 2025

Codecov Report

Attention: Patch coverage is 89.18919% with 16 lines in your changes missing coverage. Please review.

Project coverage is 72.52%. Comparing base (5170093) to head (927967c).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #876      +/-   ##
==========================================
+ Coverage   72.47%   72.52%   +0.04%     
==========================================
  Files         333      334       +1     
  Lines       50097    50244     +147     
==========================================
+ Hits        36310    36440     +130     
- Misses      13787    13804      +17     
Components Coverage Δ
crashtracker 42.90% <ø> (-0.03%) ⬇️
crashtracker-ffi 6.25% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 92.08% <ø> (ø)
data-pipeline-ffi 90.28% <ø> (ø)
ddcommon 79.19% <ø> (ø)
ddcommon-ffi 61.05% <ø> (ø)
ddtelemetry 61.74% <ø> (ø)
ddtelemetry-ffi 22.46% <ø> (ø)
dogstatsd 89.55% <89.18%> (-0.05%) ⬇️
dogstatsd-client 82.57% <ø> (ø)
ipc 82.40% <ø> (-0.11%) ⬇️
profiling 81.94% <ø> (ø)
profiling-ffi 70.68% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 40.63% <ø> (ø)
sidecar-ffi 3.23% <ø> (ø)
spawn-worker 54.37% <ø> (ø)
tinybytes 91.21% <ø> (ø)
trace-mini-agent 74.66% <ø> (ø)
trace-normalization 98.23% <ø> (ø)
trace-obfuscation 96.07% <ø> (ø)
trace-protobuf 78.13% <ø> (ø)
trace-utils 92.97% <ø> (ø)
🚀 New features to boost your workflow:
  • Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@DylanLovesCoffee
Copy link
Author

Can we get Azure Functions in on this?

Yup, we can do this but will require some updates on the backend before it's available.

@pr-commenter
Copy link

pr-commenter bot commented Feb 18, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-03-13 05:01:26

Comparing candidate commit 927967c in PR branch dylan/metric-origins with baseline commit 5170093 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 927967c 1741841332 dylan/metric-origins
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 208.546µs 209.056µs ± 0.221µs 209.024µs ± 0.138µs 209.195µs 209.421µs 209.623µs 210.252µs 0.59% 1.105 3.600 0.11% 0.016µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4756199.159op/s 4783421.250op/s ± 5042.046op/s 4784149.831op/s ± 3162.807op/s 4786782.478op/s 4790500.009op/s 4791860.545op/s 4795103.914op/s 0.23% -1.091 3.526 0.11% 356.527op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.254µs 18.329µs ± 0.026µs 18.326µs ± 0.012µs 18.345µs 18.369µs 18.390µs 18.405µs 0.43% 0.071 0.440 0.14% 0.002µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 54332014.175op/s 54559530.977op/s ± 77596.802op/s 54567557.624op/s ± 36331.893op/s 54596088.016op/s 54683360.853op/s 54775982.400op/s 54783287.916op/s 0.40% -0.061 0.443 0.14% 5486.923op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.638µs 10.699µs ± 0.027µs 10.700µs ± 0.020µs 10.718µs 10.742µs 10.753µs 10.774µs 0.69% 0.061 -0.675 0.25% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 92811984.757op/s 93471274.537op/s ± 238052.768op/s 93456017.359op/s ± 178609.317op/s 93664202.665op/s 93836387.961op/s 93902224.349op/s 93998279.002op/s 0.58% -0.051 -0.682 0.25% 16832.873op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [209.025µs; 209.086µs] or [-0.015%; +0.015%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4782722.471op/s; 4784120.029op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.325µs; 18.332µs] or [-0.020%; +0.020%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54548776.806op/s; 54570285.147op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.695µs; 10.702µs] or [-0.035%; +0.035%] None None None
normalization/normalize_name/normalize_name/good throughput [93438282.712op/s; 93504266.361op/s] or [-0.035%; +0.035%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 927967c 1741841332 dylan/metric-origins
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.894µs 3.914µs ± 0.003µs 3.914µs ± 0.001µs 3.915µs 3.917µs 3.923µs 3.928µs 0.35% -1.489 12.394 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 254606373.168op/s 255503624.726op/s ± 214509.908op/s 255495668.344op/s ± 86156.429op/s 255580965.609op/s 255796812.659op/s 255995666.846op/s 256834526.519op/s 0.52% 1.519 12.526 0.08% 15168.141op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 82.037µs 82.382µs ± 0.225µs 82.322µs ± 0.128µs 82.495µs 82.830µs 83.082µs 83.408µs 1.32% 1.320 2.273 0.27% 0.016µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11989267.051op/s 12138637.040op/s ± 33062.407op/s 12147488.835op/s ± 18990.689op/s 12161434.875op/s 12177836.826op/s 12183494.913op/s 12189686.306op/s 0.35% -1.300 2.183 0.27% 2337.865op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 76.527µs 77.086µs ± 0.270µs 77.055µs ± 0.174µs 77.251µs 77.564µs 77.737µs 77.912µs 1.11% 0.539 -0.083 0.35% 0.019µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12834926.164op/s 12972733.857op/s ± 45384.154op/s 12977692.660op/s ± 29319.421op/s 13006723.826op/s 13038017.168op/s 13048771.979op/s 13067274.248op/s 0.69% -0.522 -0.110 0.35% 3209.144op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.893µs 3.913µs ± 0.003µs 3.914µs ± 0.001µs 3.915µs 3.917µs 3.919µs 3.921µs 0.20% -2.499 18.599 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255025372.280op/s 255531294.105op/s ± 167999.331op/s 255523878.708op/s ± 72404.412op/s 255596193.628op/s 255801581.117op/s 255930665.163op/s 256858137.402op/s 0.52% 2.528 18.854 0.07% 11879.347op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 72.875µs 74.025µs ± 0.515µs 73.988µs ± 0.357µs 74.447µs 74.831µs 75.062µs 75.527µs 2.08% 0.110 -0.504 0.69% 0.036µs 1 200
credit_card/is_card_number/378282246310005 throughput 13240292.977op/s 13509687.663op/s ± 93883.924op/s 13515695.122op/s ± 65173.202op/s 13574984.823op/s 13660987.085op/s 13701355.961op/s 13722128.324op/s 1.53% -0.079 -0.518 0.69% 6638.596op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.932µs 52.182µs ± 0.093µs 52.173µs ± 0.055µs 52.236µs 52.336µs 52.402µs 52.463µs 0.56% 0.178 0.045 0.18% 0.007µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19060889.814op/s 19163739.266op/s ± 34225.287op/s 19166861.455op/s ± 20275.121op/s 19185916.100op/s 19219080.442op/s 19235612.031op/s 19255785.937op/s 0.46% -0.168 0.042 0.18% 2420.093op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.462µs 6.607µs ± 0.068µs 6.602µs ± 0.047µs 6.656µs 6.718µs 6.761µs 6.791µs 2.88% 0.040 -0.360 1.03% 0.005µs 1 200
credit_card/is_card_number/x371413321323331 throughput 147246768.226op/s 151368083.649op/s ± 1564847.699op/s 151480536.377op/s ± 1078749.282op/s 152536392.367op/s 154069374.841op/s 154541478.946op/s 154753658.310op/s 2.16% 0.011 -0.381 1.03% 110651.442op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.893µs 3.914µs ± 0.003µs 3.914µs ± 0.001µs 3.915µs 3.917µs 3.920µs 3.921µs 0.20% -2.532 18.066 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255010085.170op/s 255516928.849op/s ± 172971.977op/s 255513674.705op/s ± 59360.297op/s 255558803.922op/s 255803121.893op/s 255948410.721op/s 256866428.553op/s 0.53% 2.560 18.309 0.07% 12230.966op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 63.660µs 63.862µs ± 0.107µs 63.839µs ± 0.047µs 63.905µs 64.042µs 64.289µs 64.343µs 0.79% 1.738 4.772 0.17% 0.008µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15541793.864op/s 15658910.438op/s ± 26232.807op/s 15664408.897op/s ± 11542.081op/s 15674161.145op/s 15690042.707op/s 15703761.005op/s 15708509.299op/s 0.28% -1.719 4.684 0.17% 1854.940op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.407µs 57.520µs ± 0.063µs 57.513µs ± 0.022µs 57.537µs 57.623µs 57.747µs 57.902µs 0.68% 1.929 7.971 0.11% 0.004µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17270589.744op/s 17385153.426op/s ± 19000.098op/s 17387344.621op/s ± 6737.902op/s 17393822.584op/s 17413479.689op/s 17418479.352op/s 17419586.583op/s 0.19% -1.909 7.845 0.11% 1343.510op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.913µs ± 0.003µs 3.913µs ± 0.001µs 3.915µs 3.917µs 3.920µs 3.923µs 0.25% -1.065 5.326 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254900832.507op/s 255563480.747op/s ± 202701.174op/s 255532948.158op/s ± 90760.341op/s 255637604.294op/s 255893506.013op/s 255988623.316op/s 256750627.939op/s 0.48% 1.079 5.400 0.08% 14333.137op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.545µs 54.964µs ± 0.342µs 55.022µs ± 0.346µs 55.133µs 55.586µs 55.965µs 56.021µs 1.82% 0.766 -0.119 0.62% 0.024µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17850435.009op/s 18194556.521op/s ± 112650.762op/s 18174519.524op/s ± 114858.009op/s 18297095.798op/s 18315955.673op/s 18325957.675op/s 18333405.298op/s 0.87% -0.742 -0.185 0.62% 7965.612op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.984µs 52.209µs ± 0.108µs 52.205µs ± 0.068µs 52.271µs 52.391µs 52.473µs 52.636µs 0.82% 0.466 0.564 0.21% 0.008µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 18998545.127op/s 19153913.952op/s ± 39580.547op/s 19155236.130op/s ± 25037.219op/s 19184034.091op/s 19214507.914op/s 19231613.812op/s 19236624.610op/s 0.42% -0.451 0.531 0.21% 2798.767op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.477µs 6.647µs ± 0.064µs 6.648µs ± 0.041µs 6.686µs 6.755µs 6.791µs 6.798µs 2.27% -0.154 -0.267 0.96% 0.005µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 147097841.525op/s 150454243.766op/s ± 1443910.025op/s 150431465.888op/s ± 926707.752op/s 151355270.114op/s 153073980.907op/s 153554631.557op/s 154386712.095op/s 2.63% 0.203 -0.254 0.96% 102099.857op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.913µs; 3.914µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ throughput [255473895.715op/s; 255533353.736op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [82.351µs; 82.413µs] or [-0.038%; +0.038%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12134054.909op/s; 12143219.172op/s] or [-0.038%; +0.038%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [77.048µs; 77.123µs] or [-0.049%; +0.049%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12966444.049op/s; 12979023.664op/s] or [-0.048%; +0.048%] None None None
credit_card/is_card_number/37828224631 execution_time [3.913µs; 3.914µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255508011.013op/s; 255554577.196op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [73.953µs; 74.096µs] or [-0.096%; +0.096%] None None None
credit_card/is_card_number/378282246310005 throughput [13496676.254op/s; 13522699.072op/s] or [-0.096%; +0.096%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.169µs; 52.195µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19158995.970op/s; 19168482.562op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.598µs; 6.617µs] or [-0.143%; +0.143%] None None None
credit_card/is_card_number/x371413321323331 throughput [151151210.808op/s; 151584956.490op/s] or [-0.143%; +0.143%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.913µs; 3.914µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [255492956.596op/s; 255540901.101op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [63.847µs; 63.876µs] or [-0.023%; +0.023%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15655274.823op/s; 15662546.053op/s] or [-0.023%; +0.023%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [57.512µs; 57.529µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17382520.195op/s; 17387786.657op/s] or [-0.015%; +0.015%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255535388.314op/s; 255591573.180op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.916µs; 55.011µs] or [-0.086%; +0.086%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18178944.209op/s; 18210168.833op/s] or [-0.086%; +0.086%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.194µs; 52.224µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19148428.468op/s; 19159399.435op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.638µs; 6.656µs] or [-0.133%; +0.133%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [150254131.723op/s; 150654355.809op/s] or [-0.133%; +0.133%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 927967c 1741841332 dylan/metric-origins
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.004µs 5.068µs ± 0.034µs 5.067µs ± 0.033µs 5.092µs 5.119µs 5.121µs 5.124µs 1.14% 0.066 -1.259 0.66% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.064µs; 5.073µs] or [-0.092%; +0.092%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 927967c 1741841332 dylan/metric-origins
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 5.941ms 5.955ms ± 0.007ms 5.955ms ± 0.003ms 5.958ms 5.963ms 5.984ms 6.006ms 0.87% 3.561 20.339 0.12% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [5.954ms; 5.956ms] or [-0.017%; +0.017%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 927967c 1741841332 dylan/metric-origins
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 68.553µs 68.780µs ± 0.284µs 68.750µs ± 0.076µs 68.820µs 69.028µs 69.237µs 72.377µs 5.28% 10.331 127.648 0.41% 0.020µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [68.740µs; 68.819µs] or [-0.057%; +0.057%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 927967c 1741841332 dylan/metric-origins
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 54.535ms 54.776ms ± 0.221ms 54.698ms ± 0.069ms 54.819ms 55.224ms 55.485ms 56.252ms 2.84% 2.705 10.820 0.40% 0.016ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [54.746ms; 54.807ms] or [-0.056%; +0.056%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 927967c 1741841332 dylan/metric-origins
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 504.288µs 505.719µs ± 0.556µs 505.696µs ± 0.278µs 505.979µs 506.335µs 506.846µs 511.035µs 1.06% 4.264 40.148 0.11% 0.039µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1956814.411op/s 1977385.368op/s ± 2165.822op/s 1977474.478op/s ± 1086.767op/s 1978429.242op/s 1980141.437op/s 1981158.097op/s 1982995.374op/s 0.28% -4.186 39.219 0.11% 153.147op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 452.315µs 453.212µs ± 0.354µs 453.189µs ± 0.235µs 453.472µs 453.763µs 453.985µs 454.199µs 0.22% -0.030 -0.039 0.08% 0.025µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2201679.089op/s 2206476.052op/s ± 1721.852op/s 2206585.134op/s ± 1144.447op/s 2207599.817op/s 2209361.701op/s 2210521.759op/s 2210848.390op/s 0.19% 0.035 -0.039 0.08% 121.753op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 175.548µs 176.692µs ± 0.311µs 176.722µs ± 0.219µs 176.927µs 177.140µs 177.245µs 177.297µs 0.33% -0.575 0.305 0.18% 0.022µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5640248.705op/s 5659592.676op/s ± 9980.696op/s 5658596.450op/s ± 7005.278op/s 5666309.448op/s 5675806.267op/s 5686514.892op/s 5696460.358op/s 0.67% 0.585 0.330 0.18% 705.742op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.586µs 37.733µs ± 0.054µs 37.728µs ± 0.034µs 37.766µs 37.834µs 37.880µs 37.907µs 0.48% 0.475 0.480 0.14% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26380076.784op/s 26502246.976op/s ± 38214.819op/s 26505568.290op/s ± 23876.189op/s 26528606.861op/s 26560278.955op/s 26581588.522op/s 26605309.461op/s 0.38% -0.466 0.468 0.14% 2702.196op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.202µs 48.314µs ± 0.043µs 48.312µs ± 0.026µs 48.337µs 48.379µs 48.419µs 48.560µs 0.51% 0.968 4.917 0.09% 0.003µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20592873.509op/s 20698103.033op/s ± 18329.253op/s 20698886.130op/s ± 10948.147op/s 20709958.560op/s 20723975.603op/s 20737475.587op/s 20746056.481op/s 0.23% -0.952 4.834 0.09% 1296.074op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [505.642µs; 505.796µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1977085.206op/s; 1977685.530op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [453.163µs; 453.261µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2206237.420op/s; 2206714.684op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [176.649µs; 176.735µs] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5658209.447op/s; 5660975.904op/s] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.725µs; 37.740µs] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26496950.769op/s; 26507543.182op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.308µs; 48.320µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20695562.775op/s; 20700643.291op/s] or [-0.012%; +0.012%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 927967c 1741841332 dylan/metric-origins
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.566µs 25.607µs ± 10.657µs 17.799µs ± 0.153µs 34.595µs 43.656µs 44.923µs 89.165µs 400.94% 1.665 5.457 41.51% 0.754µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.130µs; 27.084µs] or [-5.768%; +5.768%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 927967c 1741841332 dylan/metric-origins
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 147.038µs 147.981µs ± 0.295µs 147.964µs ± 0.160µs 148.103µs 148.449µs 149.067µs 149.270µs 0.88% 1.256 3.878 0.20% 0.021µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [147.940µs; 148.022µs] or [-0.028%; +0.028%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 927967c 1741841332 dylan/metric-origins
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 244.610ns 254.661ns ± 12.339ns 249.086ns ± 3.096ns 258.345ns 280.414ns 298.846ns 300.397ns 20.60% 1.802 2.853 4.83% 0.873ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.951ns; 256.372ns] or [-0.672%; +0.672%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 927967c 1741841332 dylan/metric-origins
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.324µs 2.402µs ± 0.019µs 2.405µs ± 0.010µs 2.415µs 2.426µs 2.432µs 2.434µs 1.20% -1.835 4.430 0.80% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.399µs; 2.405µs] or [-0.111%; +0.111%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 927967c 1741841332 dylan/metric-origins
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.085µs 33.884µs ± 1.487µs 33.193µs ± 0.051µs 33.269µs 37.105µs 37.126µs 37.443µs 12.80% 1.686 0.879 4.38% 0.105µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.678µs; 34.090µs] or [-0.608%; +0.608%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 927967c 1741841332 dylan/metric-origins
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.239µs 3.198µs ± 1.430µs 3.005µs ± 0.027µs 3.026µs 3.677µs 13.907µs 14.950µs 397.47% 7.411 55.840 44.61% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.000µs; 3.396µs] or [-6.198%; +6.198%] None None None

Baseline

Omitted due to size.

@hghotra hghotra marked this pull request as ready for review March 13, 2025 05:05
@hghotra hghotra requested a review from a team as a code owner March 13, 2025 05:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants