-
Notifications
You must be signed in to change notification settings - Fork 407
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Subtask] Complete the metadata and interface design for messaging type catalog #2371
Comments
Here is the initial design document: https://docs.google.com/document/d/1NZKbM4e8iEMB0BOYD4nyzNhb3znGhxBXOE7OBx6_0zY/edit?usp=sharing |
I have some comments and pls take a look when you are free. @mchades Can you spare some time to join the discussion? @SteNicholas , thx. |
Given the complexity of message schema management, supporting message schemas in Gravitino is a substantial task. Therefore, we do not intend to support schema management in the 0.5.0 version of the stream catalog. If you have any requirements or scenarios regarding schema management through the Gravitino stream catalog, feel free to leave comments and engage in discussions on the relevant issue. Below is the design proposal for the 0.5.0 Gravitino stream catalog. |
Regarding "stream", users have provided feedback that they more easily associate it with batch processing, which is primarily used for data handling. After discussion, we have decided to change the catalog type to "Messaging", referring to the type of data managed by this catalog. |
…ing catalog (#2444) ### What changes were proposed in this pull request? This PR proposes to add the `Topic` metadata support in Gravitino. Include the API and metadata module of `Topic`. ### Why are the changes needed? This is the first work of support MQ management in Gravitino. Fix: #2371 ### Does this PR introduce _any_ user-facing change? Yes ### How was this patch tested? Add some UTs to test metadata, API test will be added when the implementation is achieved.
Describe the subtask
This issue tracks the design of the messaging catalog
Parent issue
#2369
The text was updated successfully, but these errors were encountered: