-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add cron jobs to do automatic ingest #1079
Comments
I ran into some User ID-related issues when trying to set up a CronJob recently. Here's a link to my notes about it: https://github.com/microbiomedata/infra-admin/issues/27#issuecomment-1863740052 |
Sprint over, no updates, removing from sprint and adding backlog label. If still active please move to new sprint. |
Oops sorry I think this can actually be closed now. The necessary code changes are in and Rancher configuration is done for the dev system (see the portal-ingest CronJob in nmdc-dev). The only outstanding thing to do is set up a similar CronJob in the prod namespace. But that needs to happen after the next release. Instead of keeping this issue open I'll add that as a post-release activity in microbiomedata/issues#549 |
As proposed in the Release Management Squad, it would be useful to do periodic, automatic ingests from Mongo. This would have a few benefits:
Most of the ingest is already pretty well-automated (either via the API or CLI). The manual steps currently are doing the A/B database swap and restarting the service in Rancher. I assume those can be automated via the Rancher CLI.
The text was updated successfully, but these errors were encountered: