Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] [connector-milvus] update milvus connector to support dynamic schema, failed retry, etc. #7885

Merged
merged 1 commit into from
Oct 25, 2024

Conversation

nianliuu
Copy link
Contributor

Purpose of this pull request

In this PR, we updated milvus connector to better support vector data with following improvement:

  • support read and write data by partition
  • support json data
  • support migrate dynamic schema data
  • add retry to bypass ratelimit and grpc limit
  • other minor improvements

Does this PR introduce any user-facing change?

No

How was this patch tested?

tested with real data to migrate data from milvus to milvus

Check list

@nianliuu nianliuu force-pushed the connector-milvus branch 3 times, most recently from d933aed to ee37d0e Compare October 23, 2024 03:56
@nianliuu nianliuu force-pushed the connector-milvus branch 6 times, most recently from d618271 to 54596ca Compare October 24, 2024 06:03
Copy link
Member

@Hisoka-X Hisoka-X left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM if ci passes. Thanks @nianliuu !

Hisoka-X
Hisoka-X previously approved these changes Oct 24, 2024
Copy link
Member

@Hisoka-X Hisoka-X left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@hailin0 hailin0 merged commit 6a31f91 into apache:dev Oct 25, 2024
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants