Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Increase the compatibility of id structure between the Databuilder and the Metadata Library #445

Merged

Conversation

AndrewCiambrone
Copy link
Contributor

Summary of Changes

The gremlin metadata proxy uses two id fields. The first is the default id on the vertex. ~id and they use a field called key found: https://github.com/amundsen-io/amundsenmetadatalibrary/blob/master/metadata_service/proxy/neptune_proxy.py#L117

It would require rewriting most of the queries to consolidate the two id's and I am not sure how compatible it would be with the other gremlin databases.

Note: This looks like a large change but it is mostly testing changes. The majority of the logic changes occur in the neptune serializer.

Tests

Corrected all the ids on the models

Documentation

What documentation did you add or modify and why? Add any relevant links then remove this line

CheckList

Make sure you have checked all steps below to ensure a timely review.

  • PR title addresses the issue accurately and concisely. Example: "Updates the version of Flask to v1.0.2"
  • PR includes a summary of changes.
  • PR adds unit tests, updates existing unit tests, OR documents why no test additions or modifications are needed.
  • In case of new functionality, my PR adds documentation that describes how to use it.
    • All the public functions and the classes in the PR contain docstrings that explain what it does
  • PR passes make test

@feng-tao
Copy link
Member

do we need to wait for https://github.com/amundsen-io/amundsenmetadatalibrary/pull/260/files to land?

Signed-off-by: Andrew Ciambrone <[email protected]>
@AndrewCiambrone
Copy link
Contributor Author

Yeah I think we should wait incase I need to change some of the attribute names.

@feng-tao
Copy link
Member

lgtm

@feng-tao feng-tao merged commit 6a13762 into amundsen-io:master Feb 27, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants