Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(lineage) Add Column-Level to Lineage Visualization #6138

Conversation

chriscollins3456
Copy link
Collaborator

Adds the ability to see column-level lineage inside of the lineage visualization. Draws edges between columns of different nodes if the "Show Columns" switch is on. There's also little fancy pieces like being able to click on a column and lock its highlighted lineage into place. We also sort columns when locking column lineage in place so we can always see their related columns on the first page. We also obviously paginate the columns if there are more than 10. Because of this we also added a little search filter to find the column(s) you care about.

You can also always expand and contract viewing columns on the node itself if there's too much noise.

image

With email column selected
image

Pagination
image

Searching
image

Collapsed columns
image

Checklist

  • The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
  • Links to related issues (if applicable)
  • Tests for the changes have been added/updated (if applicable)
  • Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
  • For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

@github-actions github-actions bot added the product PR or Issue related to the DataHub UI/UX label Oct 6, 2022
@github-actions
Copy link

github-actions bot commented Oct 6, 2022

Unit Test Results (build & test)

591 tests  +91   587 ✔️ +87   11m 48s ⏱️ + 10m 34s
146 suites +31       4 💤 +  4 
146 files   +31       0 ±  0 

Results for commit 78e0655. ± Comparison against base commit 3dc25c1.

♻️ This comment has been updated with latest results.

@github-actions
Copy link

github-actions bot commented Oct 6, 2022

Unit Test Results (metadata ingestion)

       8 files         8 suites   57m 32s ⏱️
   732 tests    730 ✔️ 2 💤 0
1 466 runs  1 462 ✔️ 4 💤 0

Results for commit 78e0655.

♻️ This comment has been updated with latest results.

@chriscollins3456 chriscollins3456 merged commit 1f13986 into datahub-project:master Oct 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
product PR or Issue related to the DataHub UI/UX
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants