Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Improved readers fetching in Atlas proxy #218

Merged

Conversation

mgorsk1
Copy link
Contributor

@mgorsk1 mgorsk1 commented Oct 28, 2020

Signed-off-by: mgorsk1 [email protected]

Summary of Changes

This PR introduces change in strategy for fetching frequent users for a table. Instead of using basic search, which proved to be unreliable when dealing with special characters (like dots) in qualifiedName prefix search, we created a new kind of relationship in amundsen-atlas-types and are relying on it being connected to a table.

Tests

Adjusted existing tests.

Documentation

Changed minimum version of amundsen-atlas-types

CheckList

Make sure you have checked all steps below to ensure a timely review.

  • PR title addresses the issue accurately and concisely. Example: "Updates the version of Flask to v1.0.2"
  • PR includes a summary of changes.
  • PR adds unit tests, updates existing unit tests, OR documents why no test additions or modifications are needed.
  • In case of new functionality, my PR adds documentation that describes how to use it.
    • All the public functions and the classes in the PR contain docstrings that explain what it does
  • PR passes make test

@feng-tao
Copy link
Member

cc @verdan

@mgorsk1 mgorsk1 force-pushed the feature/improvement_readers_atlas branch from aff1cb2 to 7958e8a Compare October 28, 2020 21:14
@codecov-io
Copy link

codecov-io commented Oct 29, 2020

Codecov Report

Merging #218 into master will increase coverage by 2.59%.
The diff coverage is 70.40%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #218      +/-   ##
==========================================
+ Coverage   74.10%   76.69%   +2.59%     
==========================================
  Files          25       27       +2     
  Lines        1255     1326      +71     
  Branches      136      159      +23     
==========================================
+ Hits          930     1017      +87     
+ Misses        297      265      -32     
- Partials       28       44      +16     
Impacted Files Coverage Δ
metadata_service/api/user.py 100.00% <ø> (ø)
metadata_service/proxy/shared.py 28.57% <28.57%> (ø)
metadata_service/proxy/neo4j_proxy.py 71.46% <55.73%> (-3.54%) ⬇️
metadata_service/api/badge.py 61.29% <61.29%> (ø)
metadata_service/proxy/base_proxy.py 67.08% <72.72%> (-0.06%) ⬇️
metadata_service/proxy/atlas_proxy.py 80.34% <79.19%> (-3.97%) ⬇️
metadata_service/__init__.py 76.47% <100.00%> (ø)
metadata_service/api/dashboard.py 81.81% <100.00%> (+8.48%) ⬆️
metadata_service/api/table.py 100.00% <100.00%> (ø)
metadata_service/api/tag.py 92.85% <100.00%> (ø)
... and 9 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cc3768f...53e18be. Read the comment docs.

@mgorsk1 mgorsk1 force-pushed the feature/improvement_readers_atlas branch 6 times, most recently from b121d80 to 84659c4 Compare October 29, 2020 07:11
@@ -6,7 +6,7 @@ In order to make the Atlas-Amundsen integration smooth, we've developed a python
Usage and Installation of `amundsenatlastypes` can be found [here](https://github.com/dwarszawski/amundsen-atlas-types/blob/master/README.md)

Minimum Requirements:
- amundsenatlastypes==1.1.3
- amundsenatlastypes==1.1.4
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mgorsk1 since we are on to this, can you please specify the min version of Atlas required for the Amundsen.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

https://github.com/amundsen-io/amundsen/blob/master/docs/faq.md it's available here. I will raise separate MR to update amundsen-atlas-types there

@mgorsk1 mgorsk1 force-pushed the feature/improvement_readers_atlas branch 2 times, most recently from bcf0c26 to bd40558 Compare November 2, 2020 12:00
@mgorsk1 mgorsk1 requested a review from verdan November 2, 2020 17:50
@mgorsk1 mgorsk1 force-pushed the feature/improvement_readers_atlas branch from 13722d7 to 53e18be Compare November 4, 2020 07:44
@mgorsk1 mgorsk1 merged commit 62c65fe into amundsen-io:master Nov 4, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants