Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Trino connector is not populating delta lake table properties into datahub #12421

Open
anilreddygollapalli opened this issue Jan 21, 2025 · 0 comments
Labels
bug Bug report

Comments

@anilreddygollapalli
Copy link

Describe the bug
Trino connector is not populating delta lake table properties into datahub while delta lake connector is doing the same but delta lake connector is not supporting profiling.

To Reproduce
Steps to reproduce the behavior:

  1. Use trino connector to ingest schema/profiling information for a delta lake table into datahub.
  2. Once ingestion is completed, if you check in the datahub UI for that particular delta lake table, we can see the profiling data but not properties.'

Expected behavior
We would expect properties along with profiling information in the datahub UI.

NOTE : we can see the properties for the same delta lake table when we use delta lake connector but it is not supporting/populating profiling information.
Please find attached screenshot for the same as well.

Image

Screenshots

Image

Desktop (please complete the following information):

  • OS: Windows
  • Browser Chrome
  • Version: Datahub 0.14.1

Additional context
our requirement is to ingest delta lake table with schema/properties and profiling data. but as of now using trino connector, we can ingest only profiling data without properties and when we use delta lake connector, we can ingest schema/properties but not profiling data.
Please let us know which connector we need to use to ingest schema/properties and profiling data of a delta lake table.

@anilreddygollapalli anilreddygollapalli added the bug Bug report label Jan 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Bug report
Projects
None yet
Development

No branches or pull requests

1 participant