Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DBT ingestion module works incorrectly with Case Sensitive info (fields) #6716

Closed
oleg-ruban opened this issue Dec 9, 2022 · 4 comments · Fixed by #7063
Closed

DBT ingestion module works incorrectly with Case Sensitive info (fields) #6716

oleg-ruban opened this issue Dec 9, 2022 · 4 comments · Fixed by #7063
Labels
bug Bug report ingestion PR or Issue related to the ingestion of metadata

Comments

@oleg-ruban
Copy link

Describe the bug
DBT ingestion module works correctly with low case fields only. If DBT project uses Upper case characters in the fields name of a table or view, such name will be transformed to the low case during ingestion. Moreover, in this case, the Description info will NOT be ingested.

To Reproduce
Steps to reproduce the behavior:

  1. Create a simple DBT project that creates a new View with fields in CamelCase style.
  2. Add Descriptions for those fields.
  3. Ingest this project
  4. The result: View fields in DH will be the low case, there is no Description for those fields

Expected behavior
DBT ingestion module should correctly handle Case Sensitive info

@laulpogan laulpogan added bug Bug report ingestion PR or Issue related to the ingestion of metadata labels Dec 12, 2022
@oleg-ruban
Copy link
Author

This is reproducible on 0.9.5

@oleg-ruban
Copy link
Author

It looks like Lineage is not being created for such ingestion due to this issue

@hsheth2
Copy link
Collaborator

hsheth2 commented Jan 18, 2023

@oleg-ruban I've created #7063 to fix this bug

To confirm, you're using dbt (and not dbt-cloud) - is that correct?

@oleg-ruban
Copy link
Author

Yes, you are right. I use dbt (not dbt-cloud).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Bug report ingestion PR or Issue related to the ingestion of metadata
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants