-
Notifications
You must be signed in to change notification settings - Fork 4.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Source Salesforce: Update streams.py for adapting changes with AsyncRetriever #55186
base: master
Are you sure you want to change the base?
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
/bump-version type="minor" changelog="Update manifest for adapting changes with AsyncRetriever"
|
Tests are failing because of |
Because of this, here: airbyte-cdk = "^5.10.2" The version should be: airbyte-cdk = "^6.33.3" |
Thanks @bazarnov That helps!! |
Hey @btkcodedev, thanks for the contribution! It turns out that this was more complex than anticipated. Hence, I pushed some changes. The tests will still fail. This is expected at this point. We need this fix from the CDK. Once the CDK release is done, we can up the version here and the tests should be green. At that point, I'll ask a review from another extensibility member |
This recent change has created a regression where we don't retry on timed out jobs. I've started a thread internally to try to understand why we have this change |
Everything has been updated. CATs are failing but they are failing the same way on master so I think I'm fine with this. @bazarnov can you have a review on this? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks great!
The CAT issues are about the "expected records." Some "IDs" are not matching, which is a relatively straightforward problem that can be easily resolved by updating the exptected_records
. @btkcodedev
/approve-regression-tests
|
What
Closes https://github.com/airbytehq/airbyte-internal-issues/issues/11791
How
In specific:
upgrade the CDK version to at least
6.36.3
rename the
urls_extractor
todownload_target_extractor
, here and heremove off the
stream_slice
interpolation context to use the{{creation_response['id']}}
, heremake sure the CAT passes, as before
make sure the Regression Tests pass, as before
no source behaviour changes are expected