Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(Airbyte CDK): add with_json_schema method to ConfiguredAirbyteStreamBuilder #40737

Merged
merged 12 commits into from
Jul 5, 2024

Conversation

aldogonzalez8
Copy link
Contributor

@aldogonzalez8 aldogonzalez8 commented Jul 4, 2024

What

Add with_json_schema method to ConfiguredAirbyteStreamBuilder to easily update json_schema Stream for testing purposes.

Relates to:

How

Add method and some unit testing around this change.

Review guide

  1. airbyte-cdk/python/airbyte_cdk/test/catalog_builder.py: new with_json_schema and some changes in ConnectorBuilder with_stream method to accept json_schema field.
  2. airbyte-cdk/python/unit_tests/sources/mock_server_tests/test_resumable_full_refresh.py: I removed the CatalogBuilder dependency that will be deprecated and used ConfiguredAirbyteCatalog including the with_json_schema option of the builder.

User Impact

No user impact

Can this PR be safely reverted and rolled back?

  • YES 💚
  • NO ❌

@aldogonzalez8 aldogonzalez8 requested a review from a team July 4, 2024 19:23
@aldogonzalez8 aldogonzalez8 self-assigned this Jul 4, 2024
@aldogonzalez8 aldogonzalez8 requested a review from a team July 4, 2024 19:23
Copy link

vercel bot commented Jul 4, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
airbyte-docs ⬜️ Ignored (Inspect) Visit Preview Jul 5, 2024 1:18pm

@octavia-squidington-iii octavia-squidington-iii added the CDK Connector Development Kit label Jul 4, 2024
Copy link
Contributor

@maxi297 maxi297 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I need to have a bit more information before approving

airbyte-cdk/python/airbyte_cdk/test/catalog_builder.py Outdated Show resolved Hide resolved
airbyte-cdk/python/airbyte_cdk/test/entrypoint_wrapper.py Outdated Show resolved Hide resolved
@aldogonzalez8 aldogonzalez8 force-pushed the aldogonzalez8/add_json_schema_to_builder branch from c603551 to a5a6382 Compare July 4, 2024 19:52
@octavia-squidington-iii octavia-squidington-iii removed the area/connectors Connector related issues label Jul 4, 2024
Copy link
Contributor

@maxi297 maxi297 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Last question but this should be straightforward so I'll preemptively approve

@aldogonzalez8 aldogonzalez8 merged commit 1422786 into master Jul 5, 2024
29 checks passed
@aldogonzalez8 aldogonzalez8 deleted the aldogonzalez8/add_json_schema_to_builder branch July 5, 2024 14:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants