Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix bugs in HEAL ingest #13

Open
wants to merge 15 commits into
base: main
Choose a base branch
from
Open

Fix bugs in HEAL ingest #13

wants to merge 15 commits into from

Conversation

gaurav
Copy link
Collaborator

@gaurav gaurav commented Jan 14, 2025

The VLMD format used by the Platform MDS changed at some point, causing the HEAL ingest script to stop working. This PR updates the code so it works again. It also adds an all-variable index file, which includes all the variables included in this repository.

Other minor changes:

  • Added an explicit latest tag so it's easier to change it later for testing.
  • Added a DATA_DIR configuration variable to the HEAL ingest script so that it's easier to test it locally.
  • Separate errors.log and warnings.log files are now generated with just the errors and warnings so they are easier to spot.

@gaurav gaurav added this to the Complete HEAL MDS Ingest milestone Jan 24, 2025
@gaurav gaurav marked this pull request as ready for review January 25, 2025 22:46
@gaurav gaurav requested review from yskale and hina-shah January 25, 2025 22:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant