Code

chore: Refactor Python Codebase#5113

Code

Merged

anshbansal merged 98 commits intodatahub-project:masterdatahub-project/datahub:masterfrom vincentkoc:mastervincentkoc/datahub:masterCopy head branch name to clipboardJul 6, 2022

+577-741

Commits

Commits on Jun 7, 2022

• Spelling errors in code

  

  Vincent Koc

  committed
  d7df6e9

  Copy full SHA for d7df6e9

• Use pathlib

  

  Vincent Koc

  committed
  bb26c5c

  Copy full SHA for bb26c5c

• Spelling

  

  Vincent Koc

  committed
  0c72919

  Copy full SHA for 0c72919

• Found bug in code

  

  Vincent Koc

  committed
  7eb7aa7

  Copy full SHA for 7eb7aa7

• Spelling and declare as TODO

  

  Vincent Koc

  committed
  fb069ee

  Copy full SHA for fb069ee

• Test assertions to pass

  

  Vincent Koc

  committed
  d4c36a0

  Copy full SHA for d4c36a0

• use contextlib

  

  Vincent Koc

  committed
  97617d3

  Copy full SHA for 97617d3

• dataset add col if/else simplification

  

  Vincent Koc

  committed
  2774b73

  Copy full SHA for 2774b73

• lineage emitter UTC timezone

  

  Vincent Koc

  committed
  387b9d3

  Copy full SHA for 387b9d3

• Update lineage_emitter_mcpw_rest.py

  

  Vincent Koc

  committed
  de786c3

  Copy full SHA for de786c3

• Update custom_transform_example.py

  

  Vincent Koc

  committed
  d95e8ba

  Copy full SHA for d95e8ba

• path read over open

  

  Vincent Koc

  committed
  20f770e

  Copy full SHA for 20f770e

• spelling

  

  Vincent Koc

  committed
  2b1b6b9

  Copy full SHA for 2b1b6b9

• escape strings

  

  Vincent Koc

  committed
  5562bfe

  Copy full SHA for 5562bfe

Commits on Jun 8, 2022

• Update cli_utils.py

  

  Vincent Koc

  committed
  2952cef

  Copy full SHA for 2952cef

• Update delete_cli.py

  

  Vincent Koc

  committed
  ef6b5bc

  Copy full SHA for ef6b5bc

• Update docker_check.py

  

  Vincent Koc

  committed
  0c92e2b

  Copy full SHA for 0c92e2b

• Escape

  

  Vincent Koc

  committed
  62a6dd8

  Copy full SHA for 62a6dd8

• Update migration_utils.py

  

  Vincent Koc

  committed
  26f758f

  Copy full SHA for 26f758f

• Update timeline_cli.py

  

  Vincent Koc

  committed
  03c4bf1

  Copy full SHA for 03c4bf1

• Update common.py

  

  Vincent Koc

  committed
  5ee83d9

  Copy full SHA for 5ee83d9

• Update import_resolver.py

  

  Vincent Koc

  committed
  c78fdd8

  Copy full SHA for c78fdd8

• Update yaml.py

  

  Vincent Koc

  committed
  1420932

  Copy full SHA for 1420932

• Update kafka_emitter.py

  

  Vincent Koc

  committed
  16e2c12

  Copy full SHA for 16e2c12

• Update mce_builder.py

  

  Vincent Koc

  committed
  2b0612f

  Copy full SHA for 2b0612f

• Update serialization_helper.py

  

  Vincent Koc

  committed
  85368b5

  Copy full SHA for 85368b5

• Update committable.py

  

  Vincent Koc

  committed
  af20f70

  Copy full SHA for af20f70

• Update common.py

  

  Vincent Koc

  committed
  9ab0d3d

  Copy full SHA for 9ab0d3d

• Update decorators.py

  

  Vincent Koc

  committed
  daff0e4

  Copy full SHA for daff0e4

• Update urn.py

  

  Vincent Koc

  committed
  6a79b7f

  Copy full SHA for 6a79b7f

• Update registry.py

  

  Vincent Koc

  committed
  3f48494

  Copy full SHA for 3f48494

• Update protobuf_util.py

  

  Vincent Koc

  committed
  d0b37ef

  Copy full SHA for d0b37ef

• Update datahub_ingestion_reporting_provider.py

  

  Vincent Koc

  committed
  a58dd74

  Copy full SHA for a58dd74

• Update pipeline.py

  

  Vincent Koc

  committed
  5342aaf

  Copy full SHA for 5342aaf

• Update datahub_kafka.py

  

  Vincent Koc

  committed
  759bacd

  Copy full SHA for 759bacd

• Update datahub_rest.py

  

  Vincent Koc

  committed
  b4275e1

  Copy full SHA for b4275e1

• Update pulsar.py

  

  Vincent Koc

  committed
  f12961d

  Copy full SHA for f12961d

• Update snowflake.py

  

  Vincent Koc

  committed
  d193219

  Copy full SHA for d193219

• Update bigquery_usage.py

  

  Vincent Koc

  committed
  e7dd056

  Copy full SHA for e7dd056

• Update base_transformer.py

  

  Vincent Koc

  committed
  6bf6136

  Copy full SHA for 6bf6136

• Update mark_dataset_status.py

  

  Vincent Koc

  committed
  0a1db39

  Copy full SHA for 0a1db39

• Update action.py

  

  Vincent Koc

  committed
  df463c4

  Copy full SHA for df463c4

• Update stats.py

  

  Vincent Koc

  committed
  2ab2fdd

  Copy full SHA for 2ab2fdd

• Update upgrade.py

  

  Vincent Koc

  committed
  d188171

  Copy full SHA for d188171

• Update telemetry.py

  

  Vincent Koc

  committed
  5663dc9

  Copy full SHA for 5663dc9

• Update hive_schema_to_avro.py

  

  Vincent Koc

  committed
  b57b58b

  Copy full SHA for b57b58b

• Update mapping.py

  

  Vincent Koc

  committed
  d1dda5e

  Copy full SHA for d1dda5e

• Update memory_leak_detector.py

  

  Vincent Koc

  committed
  a3839e2

  Copy full SHA for a3839e2

• Update server_config_util.py

  

  Vincent Koc

  committed
  1d180c1

  Copy full SHA for 1d180c1

• Update sql_lineage_parser_impl.py

  

  Vincent Koc

  committed
  ab48916

  Copy full SHA for ab48916

• Update sql_parser.py

  

  Vincent Koc

  committed
  bb37d4d

  Copy full SHA for bb37d4d

• Update sqlalchemy_query_combiner.py

  

  Vincent Koc

  committed
  1574080

  Copy full SHA for 1574080

• Update powerbi.py

  

  Vincent Koc

  committed
  705050e

  Copy full SHA for 705050e

• Update redash.py

  

  Vincent Koc

  committed
  b7df2f9

  Copy full SHA for b7df2f9

• Update tableau.py

  

  Vincent Koc

  committed
  2c51bc3

  Copy full SHA for 2c51bc3

• Update pulsar.py

  

  Vincent Koc

  committed
  4c9705f

  Copy full SHA for 4c9705f

• Update tableau_common.py

  

  Vincent Koc

  committed
  d4afcb7

  Copy full SHA for d4afcb7

• Update powerbi.py

  

  Vincent Koc

  committed
  c4b15e9

  Copy full SHA for c4b15e9

• Update openapi_parser.py

  

  Vincent Koc

  committed
  3cfd95a

  Copy full SHA for 3cfd95a

• Update openapi.py

  

  Vincent Koc

  committed
  99823bb

  Copy full SHA for 99823bb

• Update nifi.py

  

  Vincent Koc

  committed
  1a85c8f

  Copy full SHA for 1a85c8f

• Update mongodb.py

  

  Vincent Koc

  committed
  748d115

  Copy full SHA for 748d115

• Update metabase.py

  

  Vincent Koc

  committed
  23e4329

  Copy full SHA for 23e4329

• Update lookml.py

  

  Vincent Koc

  committed
  82509c7

  Copy full SHA for 82509c7

• Update looker_common.py

  

  Vincent Koc

  committed
  3245d7b

  Copy full SHA for 3245d7b

• Update looker.py

  

  Vincent Koc

  committed
  232dbda

  Copy full SHA for 232dbda

• Update feast.py

  

  Vincent Koc

  committed
  bc6e2b0

  Copy full SHA for bc6e2b0

• Update elastic_search.py

  

  Vincent Koc

  committed
  77609ee

  Copy full SHA for 77609ee

Commits on Jun 9, 2022

• Merge branch 'master' into master

  

  Vincent Koc

  authored
  13f017b

  Copy full SHA for 13f017b

• Running black

  

  Vincent Koc

  committed
  0dedbc8

  Copy full SHA for 0dedbc8

• running isort

  

  Vincent Koc

  committed
  95d47db

  Copy full SHA for 95d47db

• lint fix

  

  Vincent Koc

  committed
  4d708b5

  Copy full SHA for 4d708b5

• Update timeline_cli.py

  

  Vincent Koc

  committed
  ee0bc05

  Copy full SHA for ee0bc05

• logger warn to logger warning

  

  Vincent Koc

  committed
  8010744

  Copy full SHA for 8010744

• Merge branch 'master' into master

  

  Vincent Koc

  authored
  9cdf07c

  Copy full SHA for 9cdf07c

• Merge branch 'master' of github.com:koconder/datahub

  

  Vincent Koc

  committed
  07e3084

  Copy full SHA for 07e3084

Commits on Jun 11, 2022

• Update business_glossary.yml

  

  Vincent Koc

  committed
  b168138

  Copy full SHA for b168138

• Update ldap.py

  

  Vincent Koc

  committed
  980826c

  Copy full SHA for 980826c

• Merge branch 'master' into master

  

  Vincent Koc

  authored
  b507c4b

  Copy full SHA for b507c4b

Commits on Jun 12, 2022

• Merge branch 'master' of github.com:koconder/datahub

  

  Vincent Koc

  committed
  6a1e1b2

  Copy full SHA for 6a1e1b2

Commits on Jun 14, 2022

• Merge branch 'master' into master

  

  Vincent Koc

  authored
  9e50e6b

  Copy full SHA for 9e50e6b

• lint

  

  Vincent Koc

  committed
  1e60f1b

  Copy full SHA for 1e60f1b

Commits on Jun 20, 2022

• Update cli_utils.py

  

  Vincent Koc

  committed
  7c5e98d

  Copy full SHA for 7c5e98d

• Update cli_utils.py

  

  Vincent Koc

  committed
  b59d2ed

  Copy full SHA for b59d2ed

• Update cli_utils.py

  

  Vincent Koc

  committed
  4820f62

  Copy full SHA for 4820f62

Commits on Jun 24, 2022

• updates as per request

  

  Vincent Koc

  committed
  978111f

  Copy full SHA for 978111f

• Update kafka.py

  

  Vincent Koc

  committed
  391fa28

  Copy full SHA for 391fa28

• Merge branch 'master' into master

  

  Vincent Koc

  authored
  22611fc

  Copy full SHA for 22611fc

• Update powerbi.py

  

  Vincent Koc

  committed
  e299618

  Copy full SHA for e299618

• Merge branch 'master' of github.com:koconder/datahub

  

  Vincent Koc

  committed
  97337aa

  Copy full SHA for 97337aa

• lint

  

  Vincent Koc

  committed
  76150f1

  Copy full SHA for 76150f1

• Update common.py

  

  Vincent Koc

  committed
  da217c6

  Copy full SHA for da217c6

• Merge branch 'master' into master

  

  Vincent Koc

  authored
  fb2d1dd

  Copy full SHA for fb2d1dd

Commits on Jun 27, 2022

• Update mapping.py

  

  Vincent Koc

  committed
  6ab23f2

  Copy full SHA for 6ab23f2

• Update mapping.py

  

  Vincent Koc

  committed
  c7f8106

  Copy full SHA for c7f8106

Commits on Jun 29, 2022

• Merge branch 'master' into master

  

  Vincent Koc

  authored
  93ed609

  Copy full SHA for 93ed609

• Update source.py

  

  Vincent Koc

  committed
  6fc0785

  Copy full SHA for 6fc0785

Commits on Jul 6, 2022

• revert changes to functionality

  anshbansal

  committed
  2de8aee

  Copy full SHA for 2de8aee