Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(source-stripe): migrate to low-code cdk #53687

Open
wants to merge 58 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
58 commits
Select commit Hold shift + click to select a range
818c7e3
Moved created streams to low code
lazebnyi Feb 19, 2025
c11edc8
Add YamlDeclarativeSource
lazebnyi Feb 19, 2025
04800e1
Add YamlDeclarativeSource
lazebnyi Feb 19, 2025
4fcb77a
Add migrated streams to source
lazebnyi Feb 19, 2025
e3850d4
Add basic streams
lazebnyi Feb 19, 2025
c3b0303
Add changelog
lazebnyi Feb 19, 2025
24a8949
Merge branch 'master' into lazebnyi/source-stripe-move-basic-to-low-code
lazebnyi Feb 19, 2025
ca7bded
chore: auto-fix lint and format issues
octavia-squidington-iii Feb 19, 2025
9c4c4a6
Add TODO
lazebnyi Feb 19, 2025
0aeada0
Merge branch 'lazebnyi/source-stripe-move-basic-to-low-code' of githu…
lazebnyi Feb 19, 2025
3d50f65
Bump CDK version to dev
lazebnyi Feb 19, 2025
e618182
Metadata tag updated
lazebnyi Feb 19, 2025
e07384c
Fix unittests
lazebnyi Feb 20, 2025
16f9a9d
chore: auto-fix lint and format issues
octavia-squidington-iii Feb 20, 2025
fd80299
Update delivery_estimate field type in shipping_rates
lazebnyi Feb 20, 2025
5f654cd
Merge branch 'lazebnyi/source-stripe-move-basic-to-low-code' of githu…
lazebnyi Feb 20, 2025
a22bcb8
chore: auto-fix lint and format issues
octavia-squidington-iii Feb 20, 2025
8fff856
Update to last version CDK
lazebnyi Feb 20, 2025
5c88cda
Merge branch 'lazebnyi/source-stripe-move-basic-to-low-code' of githu…
lazebnyi Feb 20, 2025
27bd26f
Rollback configured catalog
lazebnyi Feb 20, 2025
95aeff7
Fix typo
lazebnyi Feb 20, 2025
27f0bcc
Fix expected record for shipping_rates
lazebnyi Feb 20, 2025
c4b0bbd
Update abnormal state
lazebnyi Feb 21, 2025
8afdde1
Apply default schema normalization
lazebnyi Feb 21, 2025
42218f4
Fixed test_created_cursor_incremental_stream
lazebnyi Feb 21, 2025
0b7d618
Update created and delivery_estimate fields to string and bypass abno…
lazebnyi Feb 21, 2025
e629188
Add comment for delivery_estimate
lazebnyi Feb 21, 2025
cbd7463
Update test_created_cursor_incremental_stream
lazebnyi Feb 21, 2025
c50b0e1
Rollback some changes for tests
lazebnyi Feb 21, 2025
5fa0e50
Format unit tests
lazebnyi Feb 21, 2025
b949077
chore: auto-fix lint and format issues
octavia-squidington-iii Feb 21, 2025
ddacec7
Add dafeault value to start date config
lazebnyi Mar 4, 2025
b7c032f
Merge branch 'master' into lazebnyi/source-stripe-move-basic-to-low-code
lazebnyi Mar 4, 2025
ba0d4e2
Merge branch 'lazebnyi/source-stripe-move-basic-to-low-code' of githu…
lazebnyi Mar 4, 2025
1e78d0e
Merge branch 'master' into lazebnyi/source-stripe-move-basic-to-low-code
lazebnyi Mar 4, 2025
4c03484
Update dependency
lazebnyi Mar 4, 2025
237edad
Migrated few streams for each stream type
lazebnyi Mar 6, 2025
dc09ef2
Merge branch 'master' into lazebnyi/source-stripe-migrate-to-low-code
lazebnyi Mar 6, 2025
3b56bbc
Update dependency
lazebnyi Mar 6, 2025
6daebd4
Merge branch 'master' into lazebnyi/source-stripe-migrate-to-low-code
lazebnyi Mar 7, 2025
fe3ea86
Add some streams
lazebnyi Mar 7, 2025
a0077c7
Update source and remove unnessesary methods
lazebnyi Mar 8, 2025
76d3bc3
chore: auto-fix lint and format issues
octavia-squidington-iii Mar 8, 2025
d0c29f9
Fix unittests
lazebnyi Mar 13, 2025
39b47f9
Update CDK dependency
lazebnyi Mar 13, 2025
8528327
Merge master to branch
lazebnyi Mar 13, 2025
ce5687c
Merge branch 'master' into lazebnyi/source-stripe-migrate-to-low-code
lazebnyi Mar 13, 2025
d1d69b8
chore: auto-fix lint and format issues
octavia-squidington-iii Mar 13, 2025
6ce7fe1
Add coverage ignore file
lazebnyi Mar 13, 2025
fdab28a
Merge branch 'lazebnyi/source-stripe-migrate-to-low-code' of github.c…
lazebnyi Mar 13, 2025
0ff37c3
Update path in .coveragerc
lazebnyi Mar 14, 2025
3835e2a
Fix 400 error handling
lazebnyi Mar 14, 2025
3f56559
chore: auto-fix lint and format issues
octavia-squidington-iii Mar 14, 2025
484418e
Fix catalog changes
lazebnyi Mar 14, 2025
04b2da0
Merge branch 'lazebnyi/source-stripe-migrate-to-low-code' of github.c…
lazebnyi Mar 14, 2025
2e0e5da
chore: auto-fix lint and format issues
octavia-squidington-iii Mar 14, 2025
9860e4f
Update CDK dependency
lazebnyi Mar 14, 2025
9271e59
Update version to 5.9.0-rc.1
lazebnyi Mar 14, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions airbyte-integrations/connectors/source-stripe/.coveragerc
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
[run]
omit =
source_stripe/run.py
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ acceptance_tests:
- config_path: "secrets/config.json"
timeout_seconds: 3600
future_state:
future_state_path: "integration_tests/abnormal_state.json"
bypass_reason: "This test does not make sense using Concurrent CDK"
# The stream `setup_attempts` fails on the `test_read_sequential_slices` step,
# `Read 1 of 1 should produce at least one record.`, expecting some records to be set on the stream.
skip_comprehensive_incremental_tests: true
Expand Down
8,307 changes: 6,172 additions & 2,135 deletions airbyte-integrations/connectors/source-stripe/erd/discovered_catalog.json

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
#
# Copyright (c) 2023 Airbyte, Inc., all rights reserved.
# Copyright (c) 2025 Airbyte, Inc., all rights reserved.
#
Original file line number Diff line number Diff line change
Expand Up @@ -65,7 +65,7 @@
{
"type": "STREAM",
"stream": {
"stream_state": { "updated": 10000000000 },
"stream_state": { "updated": 1577836800 },
"stream_descriptor": { "name": "customers" }
}
},
Expand Down Expand Up @@ -282,7 +282,7 @@
{
"type": "STREAM",
"stream": {
"stream_state": { "updated": 10000000000 },
"stream_state": { "updated": 1720010734 },
"stream_descriptor": { "name": "payment_methods" }
}
},
Expand All @@ -296,14 +296,14 @@
{
"type": "STREAM",
"stream": {
"stream_state": { "created": 10000000000 },
"stream_state": { "created": 1646998902 },
"stream_descriptor": { "name": "customer_balance_transactions" }
}
},
{
"type": "STREAM",
"stream": {
"stream_state": { "updated": 10000000000 },
"stream_state": { "updated": 1588291200 },
"stream_descriptor": { "name": "accounts" }
}
},
Expand Down
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#
# Copyright (c) 2023 Airbyte, Inc., all rights reserved.
# Copyright (c) 2025 Airbyte, Inc., all rights reserved.
#


Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@
{"stream": "accounts", "data": {"id": "acct_1MwD6tIyVv44cUB4", "object": "account", "business_profile": {"annual_revenue": null,"estimated_worker_count": null,"mcc": null, "name": null, "product_description": null, "support_address": null, "support_email": null, "support_phone": null, "support_url": null, "url": null}, "business_type": null, "capabilities": {"card_payments": "inactive", "transfers": "inactive"}, "charges_enabled": false, "country": "US", "created": 1681342196, "default_currency": "usd", "details_submitted": false, "email": "[email protected]", "external_accounts": {"object": "list", "data": [], "has_more": false, "total_count": 0, "url": "/v1/accounts/acct_1MwD6tIyVv44cUB4/external_accounts"}, "future_requirements": {"alternatives": [], "current_deadline": null, "currently_due": [], "disabled_reason": null, "errors": [], "eventually_due": [], "past_due": [], "pending_verification": []}, "metadata": {}, "payouts_enabled": false, "requirements": {"alternatives": [], "current_deadline": null, "currently_due": ["business_profile.mcc", "business_profile.url", "business_type", "external_account", "representative.first_name", "representative.last_name", "tos_acceptance.date", "tos_acceptance.ip"], "disabled_reason": "requirements.past_due", "errors": [], "eventually_due": ["business_profile.mcc", "business_profile.url", "business_type", "external_account", "representative.first_name", "representative.last_name", "tos_acceptance.date", "tos_acceptance.ip"], "past_due": ["business_profile.mcc", "business_profile.url", "business_type", "external_account", "representative.first_name", "representative.last_name", "tos_acceptance.date", "tos_acceptance.ip"], "pending_verification": []}, "settings": {"bacs_debit_payments": {"display_name": null, "service_user_number": null}, "branding": {"icon": null, "logo": null, "primary_color": null, "secondary_color": null}, "card_issuing": {"tos_acceptance": {"date": null, "ip": null}}, "card_payments": {"decline_on": {"avs_failure": false, "cvc_failure": false}, "statement_descriptor_prefix": null, "statement_descriptor_prefix_kana": null, "statement_descriptor_prefix_kanji": null}, "dashboard": {"display_name": null, "timezone": "Etc/UTC"}, "invoices": {"default_account_tax_ids": null}, "payments": {"statement_descriptor": null, "statement_descriptor_kana": null, "statement_descriptor_kanji": null}, "payouts": {"debit_negative_balances": false, "schedule": {"delay_days": 2, "interval": "daily"}, "statement_descriptor": null}, "sepa_debit_payments": {}}, "tos_acceptance": {"date": null, "ip": null, "user_agent": null}, "type": "custom"}, "emitted_at": 1697627267882}
{"stream": "accounts", "data": {"id": "acct_1Jx8unEYmRTj5on1", "object": "account", "business_profile": {"annual_revenue": null,"estimated_worker_count": null,"mcc": null, "name": "Airbyte", "support_address": null, "support_email": null, "support_phone": null, "support_url": null, "url": null}, "capabilities": {}, "charges_enabled": false, "controller": {"type": "account"}, "country": "US", "default_currency": "usd", "details_submitted": false, "email": null, "future_requirements": {"alternatives": [], "current_deadline": null, "currently_due": [], "disabled_reason": null, "errors": [], "eventually_due": [], "past_due": [], "pending_verification": []}, "metadata": {}, "payouts_enabled": false, "requirements": {"alternatives": [], "current_deadline": null, "currently_due": ["business_profile.product_description", "business_profile.support_phone", "business_profile.url", "external_account", "tos_acceptance.date", "tos_acceptance.ip"], "disabled_reason": "requirements.past_due", "errors": [], "eventually_due": ["business_profile.product_description", "business_profile.support_phone", "business_profile.url", "external_account", "tos_acceptance.date", "tos_acceptance.ip"], "past_due": [], "pending_verification": []}, "settings": {"bacs_debit_payments": {"display_name": null, "service_user_number": null}, "branding": {"icon": null, "logo": null, "primary_color": null, "secondary_color": null}, "card_issuing": {"tos_acceptance": {"date": null, "ip": null}}, "card_payments": {"statement_descriptor_prefix": null, "statement_descriptor_prefix_kana": null, "statement_descriptor_prefix_kanji": null}, "dashboard": {"display_name": null, "timezone": "Etc/UTC"}, "invoices": {"default_account_tax_ids": null}, "payments": {"statement_descriptor": null, "statement_descriptor_kana": null, "statement_descriptor_kanji": null}, "sepa_debit_payments": {}}, "type": "standard"}, "emitted_at": 1697627267884}
{"stream": "accounts", "data": {"id": "acct_1HRPLyCpK2Z3jTFF", "object": "account", "capabilities": {"acss_debit_payments": "inactive", "afterpay_clearpay_payments": "inactive", "bancontact_payments": "inactive", "card_payments": "inactive", "eps_payments": "inactive", "giropay_payments": "inactive", "ideal_payments": "inactive", "p24_payments": "inactive", "sepa_debit_payments": "inactive", "sofort_payments": "inactive", "transfers": "inactive"}, "charges_enabled": false, "country": "US", "default_currency": "usd", "details_submitted": false, "future_requirements": {"alternatives": [], "current_deadline": null, "currently_due": [], "disabled_reason": null, "errors": [], "eventually_due": [], "past_due": [], "pending_verification": []}, "payouts_enabled": false, "requirements": {"alternatives": [], "current_deadline": null, "currently_due": ["business_profile.mcc", "business_profile.product_description", "business_profile.support_phone", "business_profile.url", "external_account", "individual.dob.day", "individual.dob.month", "individual.dob.year", "individual.email", "individual.first_name", "individual.last_name", "individual.phone", "individual.ssn_last_4", "tos_acceptance.date", "tos_acceptance.ip"], "disabled_reason": "requirements.past_due", "errors": [], "eventually_due": ["business_profile.mcc", "business_profile.product_description", "business_profile.support_phone", "business_profile.url", "external_account", "individual.dob.day", "individual.dob.month", "individual.dob.year", "individual.email", "individual.first_name", "individual.last_name", "individual.phone", "individual.ssn_last_4", "tos_acceptance.date", "tos_acceptance.ip"], "past_due": ["business_profile.mcc", "business_profile.product_description", "business_profile.support_phone", "business_profile.url", "external_account", "individual.dob.day", "individual.dob.month", "individual.dob.year", "individual.email", "individual.first_name", "individual.last_name", "individual.phone", "individual.ssn_last_4", "tos_acceptance.date", "tos_acceptance.ip"], "pending_verification": []}, "settings": {"bacs_debit_payments": {"display_name": null, "service_user_number": null}, "branding": {"icon": null, "logo": null, "primary_color": null, "secondary_color": null}, "card_issuing": {"tos_acceptance": {"date": null, "ip": null}}, "card_payments": {"statement_descriptor_prefix": null, "statement_descriptor_prefix_kana": null, "statement_descriptor_prefix_kanji": null}, "dashboard": {"display_name": null, "timezone": "America/Los_Angeles"}, "invoices": {"default_account_tax_ids": null}, "payments": {"statement_descriptor": null, "statement_descriptor_kana": null, "statement_descriptor_kanji": null}, "sepa_debit_payments": {}}, "type": "standard"}, "emitted_at": 1707141120832}
{"stream": "shipping_rates", "data": {"id": "shr_1NXgplEcXtiJtvvhA1ntV782", "object": "shipping_rate", "active": true, "created": 1690274589, "delivery_estimate": "{'maximum': {'unit': 'business_day', 'value': 14}, 'minimum': {'unit': 'business_day', 'value': 10}}", "display_name": "Test Ground Shipping", "fixed_amount": {"amount": 999, "currency": "usd"}, "livemode": false, "metadata": {}, "tax_behavior": "inclusive", "tax_code": "txcd_92010001", "type": "fixed_amount"}, "emitted_at": 1697627269309}
{"stream":"shipping_rates","data":{"id":"shr_1NXgplEcXtiJtvvhA1ntV782","object":"shipping_rate","active":true,"created":1690274589,"delivery_estimate":{"maximum":{"unit":"business_day","value":14},"minimum":{"unit":"business_day","value":10}},"display_name":"Test Ground Shipping","fixed_amount":{"amount":999,"currency":"usd"},"livemode":false,"metadata":{},"tax_behavior":"inclusive","tax_code":"txcd_92010001","type":"fixed_amount"},"emitted_at":1740090575020}
{"stream": "balance_transactions", "data": {"id": "txn_1KVQhfEcXtiJtvvhF7ox3YEm", "object": "balance_transaction", "amount": -9164, "available_on": 1645488000, "created": 1645406919, "currency": "usd", "description": "STRIPE PAYOUT", "exchange_rate": null, "fee": 0, "fee_details": [], "net": -9164, "reporting_category": "payout", "source": "po_1KVQhfEcXtiJtvvhZlUkl08U", "status": "available", "type": "payout"}, "emitted_at": 1697627270253}
{"stream": "balance_transactions", "data": {"id": "txn_3K9FSOEcXtiJtvvh0KoS5mx7", "object": "balance_transaction", "amount": 5300, "available_on": 1640649600, "created": 1640120473, "currency": "usd", "description": null, "exchange_rate": null, "fee": 184, "fee_details": [{"amount": 184, "application": null, "currency": "usd", "description": "Stripe processing fees", "type": "stripe_fee"}], "net": 5116, "reporting_category": "charge", "source": "ch_3K9FSOEcXtiJtvvh0zxb7clc", "status": "available", "type": "charge"}, "emitted_at": 1697627270254}
{"stream": "balance_transactions", "data": {"id": "txn_3K9F5DEcXtiJtvvh1qsqmHcH", "object": "balance_transaction", "amount": 4200, "available_on": 1640649600, "created": 1640119035, "currency": "usd", "description": "edgao test", "exchange_rate": null, "fee": 152, "fee_details": [{"amount": 152, "application": null, "currency": "usd", "description": "Stripe processing fees", "type": "stripe_fee"}], "net": 4048, "reporting_category": "charge", "source": "ch_3K9F5DEcXtiJtvvh1w2MaTpj", "status": "available", "type": "charge"}, "emitted_at": 1697627270255}
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-stripe/main.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#
# Copyright (c) 2023 Airbyte, Inc., all rights reserved.
# Copyright (c) 2025 Airbyte, Inc., all rights reserved.
#


Expand Down
4 changes: 2 additions & 2 deletions airbyte-integrations/connectors/source-stripe/metadata.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ data:
connectorSubtype: api
connectorType: source
definitionId: e094cb9a-26de-4645-8761-65c0c425d1de
dockerImageTag: 5.8.12
dockerImageTag: 5.9.0-rc.1
dockerRepository: airbyte/source-stripe
documentationUrl: https://docs.airbyte.com/integrations/sources/stripe
erdUrl: https://dbdocs.io/airbyteio/source-stripe?view=relationships
Expand Down Expand Up @@ -55,7 +55,7 @@ data:
supportLevel: certified
tags:
- language:python
- cdk:python
- cdk:low-code
connectorTestSuitesOptions:
- suite: liveTests
testConnections:
Expand Down
Loading
Loading