Code

feat(ingest/s3): Partition support#11083

Code

Merged

treff7es merged 31 commits intodatahub-project:masterdatahub-project/datahub:masterfrom treff7es:s3_partition_supporttreff7es/datahub:s3_partition_supportCopy head branch name to clipboardAug 22, 2024

+15,894-2,746

Commits

Commits on Aug 2, 2024

• Initial commit for s3 partition support

  treff7es

  committed
  1bb1626

  Copy full SHA for 1bb1626

• Merge branch 'master' into s3_partition_support

  treff7es

  authored
  7774e5f

  Copy full SHA for 7774e5f

• black linting

  treff7es

  committed
  7db9079

  Copy full SHA for 7db9079

Commits on Aug 5, 2024

• Merge branch 'master' into s3_partition_support

  treff7es

  authored
  e8d6f3b

  Copy full SHA for e8d6f3b

• Changing enum to check if doc build succeeds

  treff7es

  committed
  45efdb7

  Copy full SHA for 45efdb7

• Update to use the latest model

  treff7es

  committed
  664bcd7

  Copy full SHA for 664bcd7

• Update golden files

  treff7es

  committed
  af6df2a

  Copy full SHA for af6df2a

• Update golden files

  Show description for 6f1de05
  treff7es

  committed
  6f1de05

  Copy full SHA for 6f1de05

• Stabilizing s3 integration tests

  treff7es

  committed
  05a132b

  Copy full SHA for 05a132b

• Updating golden again

  treff7es

  committed
  34f629b

  Copy full SHA for 34f629b

• Updating goldens again

  treff7es

  committed
  c247299

  Copy full SHA for c247299

• Fix formatting

  treff7es

  committed
  35bc791

  Copy full SHA for 35bc791

• Merge branch 'master' into s3_partition_support

  treff7es

  authored
  8d20952

  Copy full SHA for 8d20952

• - Adding option to disable partition aspect generation for backward compatibility

  treff7es

  committed
  45ee511

  Copy full SHA for 45ee511

• Black formatting

  treff7es

  committed
  f51a3e9

  Copy full SHA for f51a3e9

• Update doc

  treff7es

  committed
  20c54e2

  Copy full SHA for 20c54e2

• Merge branch 'master' into s3_partition_support

  treff7es

  authored
  e401ee9

  Copy full SHA for e401ee9

• Fix typos

  treff7es

  committed
  56e14e2

  Copy full SHA for 56e14e2

Commits on Aug 12, 2024

• Addressing pr review comments

  treff7es

  committed
  a4cbdb9

  Copy full SHA for a4cbdb9

• Merge branch 'master' into s3_partition_support

  Show description for d5aee9d
  treff7es

  committed
  d5aee9d

  Copy full SHA for d5aee9d

Commits on Aug 13, 2024

• Merge branch 'master' into s3_partition_support

  treff7es

  authored
  b0c8799

  Copy full SHA for b0c8799

• Fix linter issues

  treff7es

  committed
  4d6502a

  Copy full SHA for 4d6502a

Commits on Aug 21, 2024

• Update metadata-ingestion/docs/sources/s3/s3.md

  Show description for cb56197
  

  treff7es

  and

  mayurinehate

  authored
  cb56197

  Copy full SHA for cb56197

• Update metadata-ingestion/src/datahub/ingestion/source/data_lake_common/path_spec.py

  Show description for ab36e00
  

  treff7es

  and

  mayurinehate

  authored
  ab36e00

  Copy full SHA for ab36e00

• Update metadata-ingestion/src/datahub/ingestion/source/data_lake_common/path_spec.py

  Show description for 662fa52
  

  treff7es

  and

  mayurinehate

  authored
  662fa52

  Copy full SHA for 662fa52

• Update metadata-ingestion/src/datahub/ingestion/source/s3/source.py

  Show description for 12d6150
  

  treff7es

  and

  coderabbitai[bot]

  authored
  12d6150

  Copy full SHA for 12d6150

• Update metadata-ingestion/src/datahub/ingestion/source/s3/source.py

  Show description for a07216e
  

  treff7es

  and

  coderabbitai[bot]

  authored
  a07216e

  Copy full SHA for a07216e

• Update metadata-ingestion/docs/sources/s3/s3.md

  Show description for e8c4f74
  

  treff7es

  and

  mayurinehate

  authored
  e8c4f74

  Copy full SHA for e8c4f74

• Addressing pr review comments

  treff7es

  committed
  b929f6a

  Copy full SHA for b929f6a

• Merge branch 'master' into s3_partition_support

  treff7es

  authored
  ee2b827

  Copy full SHA for ee2b827

• Update golden files

  treff7es

  committed
  0ce1174

  Copy full SHA for 0ce1174