Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Silently dropped metrics when using sendDistributionMetric #638

Open
AaronMoat opened this issue Mar 13, 2025 · 1 comment
Open

Silently dropped metrics when using sendDistributionMetric #638

AaronMoat opened this issue Mar 13, 2025 · 1 comment

Comments

@AaronMoat
Copy link

AaronMoat commented Mar 13, 2025

Description

I have a Lambda function, without log forwarding, that issues a high count of metrics with sendDistributionMetric.

I have noticed that, at times, some subset of a Lambda invocation's metrics are silently dropped. I tried running with { shouldRetryMetrics: true, debugLogging: true }, with no useful output from the debugger to distinguish successful runs and unsuccessful runs.

Upon looking into this repo's code, I noticed that b20c40e introduced a change where we continually recreate this.currentProcessor, meaning that when we await it during flushing at the end of the lambda invocation, it's only awaiting one of the calls to sendDistributionMetric, not all of them. This could be causing my problem.

Does this sound correct?

Specifications

  • Datadog Lambda Layer version: 72
  • Node version: nodejs20.x
@astuyve
Copy link
Contributor

astuyve commented Mar 13, 2025

Hi @AaronMoat thanks for the note!

Would you mind opening a support ticket with us so we could take a closer look? You can use the in-app chat or even just email [email protected]. Please include this issue in the report as to help expedite the process.

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants