New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: add anthropic support and prompt truncation #2114

Draft

sentry-autofix wants to merge 2 commits into main from autofix/feat/anthropic-support

Contributor

sentry-autofix bot commented Mar 7, 2025

👋 Hi there! This PR was automatically generated by Autofix 🤖

This fix was triggered by Jenn Mueng

Adds support for Anthropic models via a new LlmClient class.
Implements prompt truncation to ensure prompts fit within token limits for Anthropic.
Adds token estimation function for Anthropic.
Adds timeout check to the stream with differentiated timeouts for first token and subsequent tokens.
Adds fallback to OpenAI for oversized prompts.
Fixes a bug where overloaded errors were not being handled correctly.

If you have any questions or feedback for the Sentry team about this fix, please email [email protected] with the Run ID: 8336.

sentry-autofix bot and others added 2 commits

March 7, 2025 00:08


          feat: add anthropic support and prompt truncation

ea4d563


          🛠️ apply pre-commit fixes

8dd58fd

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet