Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add default cypher query for user/dashboard entity to search extractor #220

Merged
merged 1 commit into from
Mar 11, 2020
Merged

Add default cypher query for user/dashboard entity to search extractor #220

merged 1 commit into from
Mar 11, 2020

Conversation

feng-tao
Copy link
Member

@feng-tao feng-tao commented Mar 11, 2020 •
edited
Loading

Summary of Changes

As we removed the dashboard search extractor(#219) due to its duplication, we provide the search default query for user/dashboard here.

Provide a new config to allow user select different cypher query.

Tests

What tests did you add or modify and why? If no tests were added or modified, explain why. Remove this line

Documentation

What documentation did you add or modify and why? Add any relevant links then remove this line

CheckList

Make sure you have checked all steps below to ensure a timely review.

  • PR title addresses the issue accurately and concisely. Example: "Updates the version of Flask to v1.0.2"
  • PR includes a summary of changes.
  • PR adds unit tests, updates existing unit tests, OR documents why no test additions or modifications are needed.
  • In case of new functionality, my PR adds documentation that describes how to use it.
    • All the public functions and the classes in the PR contain docstrings that explain what it does
  • PR passes make test

@feng-tao feng-tao requested a review from jinhyukchang March 11, 2020 19:26
@codecov-io
Copy link

codecov-io commented Mar 11, 2020 •
edited
Loading

Codecov Report

Merging #220 into master will increase coverage by 0.23%.
The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #220      +/-   ##
==========================================
+ Coverage   77.59%   77.82%   +0.23%     
==========================================
  Files          84       84              
  Lines        3561     3567       +6     
  Branches      339      339              
==========================================
+ Hits         2763     2776      +13     
+ Misses        706      698       -8     
- Partials       92       93       +1
Impacted Files Coverage Δ
...tabuilder/extractor/neo4j_search_data_extractor.py 88.88% <100%> (+25.55%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cf7a28c...8ff51e3. Read the comment docs.

jinhyukchang
jinhyukchang approved these changes Mar 11, 2020
View reviewed changes
Copy link
Contributor

@jinhyukchang jinhyukchang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good!

@feng-tao feng-tao merged commit 824c9e4 into master Mar 11, 2020
@feng-tao feng-tao deleted the tfeng_add_neo4j_search_query branch March 11, 2020 22:04
ccarterlandis pushed a commit to Gusto/amundsendatabuilder_contrib that referenced this pull request Aug 7, 2020
@alevene @jinhyukchang
@lukelowery @friendtocephalopods @rsyi @csteez @feng-tao @samshuster @jornh
Merge upstream and upgrade to 2.4.3 (amundsen-io#9)
6b73eaf 
* Patch to fix backward incompatible issue on table metadata (amundsen-io#195)

* Backward compatible patch

* Increment version

* Update

* escaping backslashes in neo4j publisher (amundsen-io#191)

* escaping backslashes in neo4j publisher

* removing an extra backslash

* Bumping versions to 1.5.3

* Mode Dashboard extractor with Generic REST API Query (amundsen-io#194)

* Initial check in on REST API Query

* Working version

* docstring

* Update

* Update

* Make unit test happy

* Update docstring

* Update

* Update

* Update

* Adding unit tests

* Updated README.md

* jsonpath_rw to extra_requires

* update models for 2.0.0 (amundsen-io#188)

* update models for 2.0.0

schema_name -> schema in table model
update search model to use schema, last_updated_timestamp

* update name -> full_name

* Mode Dashboard execution timestamp and state (amundsen-io#197)

* Initial commit

* Update

* Update

* Update

* flake8

* Update docstring

* Update

* Update

* Add mode_dashboard_constants and mode_dashboard_utils

* Add more to Util

* Added back model class to ModeDashboardExtractor

* flake8

* Address PR comments

* Fix Sample Scripts and Data (amundsen-io#199)

* Change schema_name -> schema in sample_table_programmatic_source.csv

* Update schema_name -> schema in sample_data_loader

* Change name -> full_name in  sample_user.csv

* Change name -> full_name in sample_data_loader.py

* Retrigger CLA Check

* Fix broken HiveTableMetadataExtractor. (amundsen-io#201)

* Fix.

* Update corresponding tests.

* Replace schema_name with  and fix presto as well.

* Replace unit test with schema, since we renamed schema_name back to .

* Update setup.py

Co-authored-by: Tao Feng <[email protected]>

* Follow up patches on v2 field name changes (amundsen-io#202)

* Mode dashboard owner (amundsen-io#200)

* Mode dashboard owner

* Not having dashboard_owner to create User node

* Update

* Support unicode in file_system_neo4j_csv_loader (amundsen-io#203)

* Support unicode in file_system_neo4j_csv_loader

* increment version

* Update

* Update

* Let Python3 use csv not unicodecsv

* Add badges to Neo4jExtractor and elastic search  (amundsen-io#204)

* Add badges to Neo4jSearchExtractor

* update publisher to have badges

* update elastic search document

* fix typo

* update name

* filter tags by type

* typo

* do not filter tags because then i can't get badges on staging :|

* update tests

* fix tests

* use amunsen_common for elastic search index

* revert commit using amundsencommon

* add comment

* make backwards compatible

* remove badges from tags

* Mode Dashboard last successful execution (amundsen-io#205)

* Mode Dashboard last successful execution

* Increment version

* Remove py27 Antlar presto sql usage extractor (amundsen-io#208)

* Remove py27 Antlar presto sql usage extractor

* remove more

* remove pytest macro

* Removing Sample Csv Data Loader and Cleaning up Sample Data Loader (amundsen-io#206)

* refactored TableColumnCsvExtractor to the csv_extractors file.
removing sample_csv_data_loader.py
simplified sample_data_loader.py
Finally, modified sample data so that popular table shows by default again.

* Update sample_data_loader.py

Co-authored-by: Tao Feng <[email protected]>

* Added created timestamp and last modified timestamp on Dashboard (amundsen-io#207)

* Added created timestamp and last modified timestamp on Dashboard

* Remove owner and reload time from dashboard_metadata

* Move dashboard_metadata under dashboard package

* Update

* Update

* Added dashboard group url and dashboard url

* Added cluster node in Dashboard

* Optimize Neo4j Cypher query on Neo4jSearchDataExtractor (amundsen-io#213)

* Optimize Neo4j Cypher query on Neo4jSearchDataExtractor

* flake8

* Add Dashboard Table model (amundsen-io#210)

* Add Dashboard Table model

* Update dashboard_table.py

* Update test_dashboard_table.py

* bump version

* Remove antlr4 deps (amundsen-io#214)

* Update dashboard ES doc (amundsen-io#218)

* Remove neo4j dashboard/metric extractor (amundsen-io#219)

* Add default cypher query for user/dashboard entity to search extractor (amundsen-io#220)

* Update the query publish tag to match entity (amundsen-io#221)

* issue-320 documentation of models (amundsen-io#217)

* Start if issue-320 documentatino of models

* adding more documentation

* Adding BigQuery to the readme (amundsen-io#222)

* Adding Bigquery to the readme

* fixing link

* Rename sample_dag.py to hive_sample_dag.py (amundsen-io#223)

To clarify what this sample is about. 
A year ago this folder only had one file :)

* Adding Mode dashboard usage extractor and generic loader (amundsen-io#225)

* Adding Mode dashboard usage extractor and generic loader

* Update

* Increment version

* Add query and chart on Dashboard (amundsen-io#224)

* Add query and chart on Dashboard

* Update

* Increment version

* Update test case

* Add title field in user model (amundsen-io#227)

* Add title field in user model

* fix one more test

* Slight change from title to role name (amundsen-io#228)

* Update python version for databuilder (amundsen-io#229)

* Dashboard usage model (amundsen-io#226)

* Added Dashboard usage model

* Update

* Update

* Update

* Clarify ES publisher warning on first run (amundsen-io#230)

* Add role_name to user ES doc (amundsen-io#232)

* minor mods to get tests to pass

* tweak schema field after testing demo execution

* move Table into simple_sql_parser now that we're not trying to conform to a missing presto parser

* add role_name to sample_data_loader

Co-authored-by: Jin Hyuk Chang <[email protected]>
Co-authored-by: Luke Lowery <[email protected]>
Co-authored-by: friendtocephalopods <[email protected]>
Co-authored-by: Jacob Kim <[email protected]>
Co-authored-by: Robert Yi <[email protected]>
Co-authored-by: Tao Feng <[email protected]>
Co-authored-by: christina stead <[email protected]>
Co-authored-by: Tao Feng <[email protected]>
Co-authored-by: samshuster <[email protected]>
Co-authored-by: jornh <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jinhyukchang jinhyukchang jinhyukchang approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@feng-tao @codecov-io @jinhyukchang