Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Towards ensemble hofx support #298

Merged
merged 39 commits into from
Mar 20, 2024
Merged

Towards ensemble hofx support #298

merged 39 commits into from
Mar 20, 2024

Conversation

CEgerer93
Copy link
Contributor

@CEgerer93 CEgerer93 commented Feb 15, 2024

Description

Extends the localensembleda suite by separating the ensemble H(x) computation from the analysis step. Introduced structures to compute ensemble observers in either a serial or parallel workflow.

  • In addition, a new option (-p) has been added to swell task that should be triggered when ensemble workflows are run. This new option specifies to an ensemble-related task which "packet" of ensemble members it should handle. Together with additional suite/task questions, ensemble-related tasks can operate on mutually exclusive subsets of ensemble members.

Impact

  • introduces a default parameter to RunJediHofxExecutable class in run_jedi_hofx_executable.py to produce hofx yamls for each ensemble member; minor rearrangement of said script as well.

@Dooruk edit:

@asewnath and I had to make some additional changes to make sure hofx_executable wasn't impacted.

I confined the ensemble_packet related entries to task_questions, which worked fine but we should see how do they work with the questionnaire.

There still needs to be another task to combine individual h(x)_* outputs as LETKF executable requires observations to be in the same IODA file with the hofx0** naming convention.

Thanks @CEgerer93 for working on this and for your changes.

CEgerer93 and others added 19 commits December 20, 2023 11:53
@CEgerer93 CEgerer93 added the enhancement New feature or request label Feb 15, 2024
@CEgerer93 CEgerer93 linked an issue Feb 15, 2024 that may be closed by this pull request
@rtodling
Copy link
Contributor

I think you are requesting for too many reviewers for this. It delays things too much.

Copy link
Contributor

@rtodling rtodling left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Other than minor comments, and w/o trying to run this - things look ok by me.

@Dooruk Dooruk removed the request for review from rgelaro March 19, 2024 23:49
@Dooruk Dooruk merged commit 7831f87 into develop Mar 20, 2024
11 checks passed
@Dooruk Dooruk deleted the feature/localensembleda/Hofx branch March 20, 2024 14:36
danholdaway added a commit to danholdaway/swell that referenced this pull request Apr 19, 2024
* develop:
  Resolve pandas warnings (GEOS-ESM#322)
  Add atmospheric 3DVar case (GEOS-ESM#302)
  Update to Skylab7 Modules - Part 1 (SLES12) (GEOS-ESM#319)
  Towards ensemble hofx support (GEOS-ESM#298)
  Change Jedi Log plot and turn off Jb evaluation (GEOS-ESM#310)
  passed benchmark change (GEOS-ESM#303)
  Use `EXPLICIT_DIFFUSION` as Static Background for `geos_marine` (GEOS-ESM#301)
  Fix to check for missing obs in SaveObsDiag (GEOS-ESM#299)
  Cloning GEOS_mksi instead for GSI channel records (GEOS-ESM#297)
  Update modules and keep static files in shared locations (GEOS-ESM#296)
  Addressing missing observations (GEOS-ESM#286)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add new Swell CLI option
5 participants