[Feature Request]: [Milvus]Partition

[zc277584121]

Feature Description

• Needs:
  • Milvus has advanced partition management features, e.g. Partition-key, partition-names. They should be introduced into LlamaIndex
• Methods:
  • New class PartitionConfigs, new param at init partition_configs (PartitionConfigs):
    • partition_key_field(List[str]): defaults to None; if collection does not exist, create with a scalar field (VarChar, max_length 65535).
    • num_partitions(int):defaults to 16; works only if partition_key_field is specified.
    • partition_names(List[str]): defaults to None; if not None:
      • create partitions if not exist
      • load partitions instead of collection (align with Collection load design)
  • Change in other api: When partition_names is given at init, pass it into insert/search etc. if possible.
• New features examples should be added into https://docs.llamaindex.ai/en/stable/examples/vector_stores/MilvusIndexDemo/
• Should write and pass corresponding unit test for all new features & changes

Reason

No response

Value of Feature

No response

[dosubot]

Hi, @zc277584121. I'm Dosu, and I'm helping the LlamaIndex team manage their backlog. I'm marking this issue as stale.

Issue Summary:

• You proposed integrating advanced partition management features from Milvus into LlamaIndex.
• Suggested the introduction of a PartitionConfigs class for handling partition configurations.
• Recommended modifying existing APIs, updating documentation, and adding unit tests.
• No comments or activity have occurred on this issue since it was opened.

Next Steps:

• Please let me know if this issue is still relevant to the latest version of the LlamaIndex repository by commenting here to keep the discussion open.
• If there is no further activity, this issue will be automatically closed in 7 days.

Thank you for your understanding and contribution!