-
Notifications
You must be signed in to change notification settings - Fork 4.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add discovered catalog refresh functionality #1000
Comments
Small question: to detect that catalogs changed (amended/expanded or contracted), are they going to be persisted/stored somewhere? if yes, where? Is it going to be handled in a similar way to states? |
As a side note for the future, it would be really great, if we can send notifications (slack, email, etc) when such changes happen to the catalogs... So that user can decide to go select or un-select new fields/streams or be aware that the Analytics pipelines downstream may get affected (if streams/fields were removed, then some expected data could stop being replicated/refreshed). |
@ChristopheDuong love the notifications idea! the infrastructure for that would also get us closer to having an "audit log" of schema changes for debuggability FWIW this issue is getting bumped out of the next release, see #996 for more context |
Closing in favor of the epic #14278 |
See #996 for context
In the scheduler, add a process which runs discovery then performs one of the following actions:
┆Issue is synchronized with this Asana task by Unito
The text was updated successfully, but these errors were encountered: