Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Importers not updating post-Knapsack #172

Closed
Tracked by #134
KatharineV opened this issue Apr 18, 2024 · 3 comments
Closed
Tracked by #134

Importers not updating post-Knapsack #172

KatharineV opened this issue Apr 18, 2024 · 3 comments
Assignees
Labels
bug something isn't working Knapsack Upgrade

Comments

@KatharineV
Copy link
Collaborator

Earlier this week, I started two imports on ADL prod to test Knapsack. I found metadata errors in the CSVs, so I edited and resubmitted the imports on 4/17. The "last run" dates haven't updated and the metadata hasn't updated, so it appears that the importers have no rerun as expected. I did see confirmation messages after I submitted updates, and I also see the new CSV files are attached in the Import file path field of the Edit Importer screen. However, the new CSV hasn't run, and the delay is fully 24 hours now. I expect the importer to edit and rerun much more quickly. Ideally, it should be within an hour or two (if not faster, in an idea environment), since the edit only updated metadata, not files.

The importers that have not updated with the newly attached CSVs:
https://adl.b2.adventistdigitallibrary.org/importers/309?locale=en
https://adl.b2.adventistdigitallibrary.org/importers/310?locale=en (this one, in fact, is stuck pending and has been since it first ran)

@KatharineV
Copy link
Collaborator Author

May be related to #170 ?

@ShanaLMoore
Copy link

refer to comment on 757

@ShanaLMoore ShanaLMoore changed the title Importers not updating post-Knapsack (slow/stuck) Importers: not updating post-Knapsack Apr 23, 2024
@ShanaLMoore ShanaLMoore changed the title (slow/stuck) Importers: not updating post-Knapsack Importers not updating post-Knapsack Apr 23, 2024
@KatharineV
Copy link
Collaborator Author

These importers have run and the metadata is updated, so I'll move this to the Done column. I assume that any importer to update metadata would work equally as well now, post-Knapsack. However, we're back to the major migration of adl:issue from OAI, so I know the workers are swamped. I won't be testing further in production.

@kirkkwang kirkkwang transferred this issue from notch8/adventist-dl May 10, 2024
@jillpe jillpe moved this to Done in adventist-dl May 10, 2024
@jillpe jillpe closed this as completed May 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug something isn't working Knapsack Upgrade
Projects
Status: Done
Status: Done
Development

No branches or pull requests

4 participants