-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add column stats to unity catalog profiler #719
Add column stats to unity catalog profiler #719
Conversation
This pull request has been linked to Shortcut Story #22812: Add column stats to Unity Catalog profiler. |
☂️ Python Coverage
Overall Coverage
New FilesNo new covered files... Modified Files
|
Codecov ReportAttention:
Additional details and impacted files@@ Coverage Diff @@
## main #719 +/- ##
==========================================
+ Coverage 91.19% 91.39% +0.20%
==========================================
Files 169 135 -34
Lines 14371 14257 -114
==========================================
- Hits 13105 13030 -75
+ Misses 1266 1227 -39 ☔ View full report in Codecov by Sentry. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Go Go
🤔 Why?
It is also possible to get column stats from databricks sql client, best if we can support that.
🤓 What?
Parses column stats with databricks sql client, and stores the info in
Dataset.field_statistics
.🧪 Tested?
Tested locally.
☑️ Checks
pyproject.toml
.