Merge pull request #2140 from YaliMao-NOAA/release/gfs.v16.3.13

Update WAFS package to produce high resolution WAFS output to meet 2023 ICAO milestone Refs #2013
NOAA-EMC · Dec 12, 2023 · dfb86a2 · dfb86a2
2 parents 33d92be + 232e0a7
commit dfb86a2
Show file tree

Hide file tree

Showing 9 changed files with 158 additions and 25 deletions.
diff --git a/Externals.cfg b/Externals.cfg
@@ -43,7 +43,7 @@ protocol = git
 required = True
 
 [EMC_gfs_wafs]
-tag = gfs_wafs.v6.3.1
+tag = gfs_wafs.v6.3.2
 local_path = sorc/gfs_wafs.fd
 repo_url = https://github.com/NOAA-EMC/EMC_gfs_wafs.git
 protocol = git

diff --git a/docs/Release_Notes.gfs.v16.3.13.md b/docs/Release_Notes.gfs.v16.3.13.md
@@ -0,0 +1,145 @@
+GFS V16.3.13 RELEASE NOTES
+
+-------
+PRELUDE
+-------
+
+This upgrade to the GFS includes updates to WAFS
+
+WAFS:
+
+  At GFS v16.3 implementation, UPP and WAFS package were updated to be ready to produce high resolution WAFS output to meet 2023 ICAO milestone with one switch.
+  The switch was turned off at GFS v16.3. Now that UKMO has started to produce their corresponding high resolution WAFS output, EMC will work with NCO to turn on the switch.
+
+  Additionally, EMC is updating WAFS ecf definition file to:
+  1. trigger WAFS blending job 5 min later from 4:25 to 4:30 to compensate for 5-10 min delay in receiving UKMO high resolution data;
+  2. stop producing blended 1.25 deg WAFS file per ICAO milestone.
+
+  Both sides agreed that we sill stop waiting for data from the other side at T+4:45.
+
+IMPLEMENTATION INSTRUCTIONS
+---------------------------
+
+The NOAA VLab and the NOAA-EMC and NCAR organization spaces on GitHub .com are used to manage the GFS code.  The SPA(s) handling the GFS implementation need to have permissions to clone VLab Gerrit repositories and private NCAR UPP_GTG repository. All NOAA-EMC organization repositories are publicly readable and do not require access permissions.  Please proceed with the following steps to install the package on WCOSS2:
+
+```bash
+cd $PACKAGEROOT
+mkdir gfs.v16.3.13
+cd gfs.v16.3.13
+git clone -b EMC-v16.3.13 https://github.com/NOAA-EMC/global-workflow.git .
+cd sorc
+./checkout.sh -o
+```
+
+The checkout script extracts the following GFS components:
+
+| Component | Tag         | POC               |
+| --------- | ----------- | ----------------- |
+| MODEL     | GFS.v16.3.1   | [email protected] |
+| GLDAS     | gldas_gfsv16_release.v.2.1.0 | [email protected] |
+| GSI       | gfsda.v16.3.12 | [email protected] |
+| UFS_UTILS | ops-gfsv16.3.0 | [email protected] |
+| POST      | upp_v8.3.0 | [email protected] |
+| WAFS      | gfs_wafs.v6.3.2 | [email protected] |
+
+To build all the GFS components, execute:
+```bash
+./build_all.sh
+```
+The `build_all.sh` script compiles all GFS components. Runtime output from the build for each package is written to log files in directory logs. To build an individual program, for instance, gsi, use `build_gsi.sh`.
+
+Next, link the executables, fix files, parm files, etc in their final respective locations by executing:
+```bash
+./link_fv3gfs.sh nco wcoss2
+```
+
+Lastly, link the ecf scripts by moving back up to the ecf folder and executing:
+```bash
+cd ../ecf
+./setup_ecf_links.sh
+```
+VERSION FILE CHANGES
+--------------------
+
+* `versions/run.ver` - change `version=v16.3.13` and `gfs_ver=v16.3.13`
+
+SORC CHANGES
+------------
+
+* No changes from GFS v16.3.12
+
+JOBS CHANGES
+------------
+
+* No changes from GFS v16.3.12
+
+PARM/CONFIG CHANGES
+-------------------
+
+* No changes from GFS v16.3.12
+
+SCRIPT CHANGES
+--------------
+
+* Update ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_blending_0p25.ecf to ICAO2023=yes
+* Update ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_grib2.ecf to ICAO2023=yes
+* Update ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_grib2_0p25.ecf to ICAO2023=yes
+* Update ecf/scripts/gfs/atmos/post_processing/jgfs_atmos_wafs_gcip.ecf to ICAO2023=yes
+* In ecf/defs/gfs_v16_3.def, remove jgfs_atmos_wafs_blending task, delay trigger time of jgfs_atmos_wafs_blending_0p25 by 5 minutes
+* Update scripts/exgfs_atmos_wafs_grib2_0p25.sh to add forecast hour window to dbn_alert for awf and WAFS unblended hazard data
+* In scripts/exgfs_atmos_wafs_grib2.sh, add dbn_alert of non-headed non-hazard 1.25 deg data (gfs.tCCz.wafs_grb45fFF.grib2) with subtype GFS_WAFS_1P25_GB2
+
+FIX CHANGES
+-----------
+
+* No changes from GFS v16.3.12
+
+MODULE CHANGES
+--------------
+
+* No changes from GFS v16.3.12
+
+CHANGES TO FILE SIZES
+---------------------
+
+* WAFS - There will be file size increases.  Please see page 2 of the following Google slide:
+https://docs.google.com/presentation/d/1VtPhyYXTe_PS9gXZGMrMPlQ32ELl-JJem-Vq8vO4j_U/edit#slide=id.g134dd9cf8ea_0_107
+
+ENVIRONMENT AND RESOURCE CHANGES
+--------------------------------
+
+* jgfs_atmos_wafs_grib2_0p25.ecf changes from "mpiprocs=11:ompthreads=1:ncpus=11:mem=80GB" to "mpiprocs=39:ompthreads=1:ncpus=39:mem=200GB" because there will be 39 forecast hours and each forecast hour uses one processor through MPMD.
+
+PRE-IMPLEMENTATION TESTING REQUIREMENTS
+---------------------------------------
+
+* Which production jobs should be tested as part of this implementation?
+  * WAFS
+* Does this change require a 30-day evaluation?
+  * No
+
+DISSEMINATION INFORMATION
+-------------------------
+
+* No changes from GFS v16.3.12
+
+HPSS ARCHIVE
+------------
+
+* No changes from GFS v16.3.12
+
+JOB DEPENDENCIES AND FLOW DIAGRAM
+---------------------------------
+
+* No changes from GFS v16.3.12
+
+DOCUMENTATION
+-------------
+
+* No changes from GFS v16.3.12
+
+PREPARED BY
+-----------
+[email protected]
+[email protected]
+[email protected]
diff --git a/ecf/defs/gfs_v16_3.def b/ecf/defs/gfs_v16_3.def
@@ -1584,12 +1584,9 @@ suite gfs_v16_3
                     trigger ../../post/jgfs_atmos_post_f000 == complete
                   task jgfs_atmos_wafs_grib2_0p25
                     trigger ../../post/jgfs_atmos_post_f036 == complete
-                  task jgfs_atmos_wafs_blending
-                    trigger ./jgfs_atmos_wafs_grib2 == complete
-                    time 04:33
                   task jgfs_atmos_wafs_blending_0p25
                     trigger ./jgfs_atmos_wafs_grib2_0p25 == complete
-                    time 04:25
+                    time 04:30
                 endfamily
                 family bufr_sounding
                   task jgfs_atmos_postsnd
@@ -4212,12 +4209,9 @@ suite gfs_v16_3
                     trigger ../../post/jgfs_atmos_post_f000 == complete
                   task jgfs_atmos_wafs_grib2_0p25
                     trigger ../../post/jgfs_atmos_post_f036 == complete
-                  task jgfs_atmos_wafs_blending
-                    trigger ./jgfs_atmos_wafs_grib2 == complete
-                    time 10:33
                   task jgfs_atmos_wafs_blending_0p25
                     trigger ./jgfs_atmos_wafs_grib2_0p25 == complete
-                    time 10:25
+                    time 10:30
                 endfamily
                 family bufr_sounding
                   task jgfs_atmos_postsnd
@@ -6839,12 +6833,9 @@ suite gfs_v16_3
                     trigger ../../post/jgfs_atmos_post_f000 == complete
                   task jgfs_atmos_wafs_grib2_0p25
                     trigger ../../post/jgfs_atmos_post_f036 == complete
-                  task jgfs_atmos_wafs_blending
-                    trigger ./jgfs_atmos_wafs_grib2 == complete
-                    time 16:33
                   task jgfs_atmos_wafs_blending_0p25
                     trigger ./jgfs_atmos_wafs_grib2_0p25 == complete
-                    time 16:25
+                    time 16:30
                 endfamily
                 family bufr_sounding
                   task jgfs_atmos_postsnd
@@ -9468,12 +9459,9 @@ suite gfs_v16_3
                     trigger ../../post/jgfs_atmos_post_f000 == complete
                   task jgfs_atmos_wafs_grib2_0p25
                     trigger ../../post/jgfs_atmos_post_f036 == complete
-                  task jgfs_atmos_wafs_blending
-                    trigger ./jgfs_atmos_wafs_grib2 == complete
-                    time 22:33
                   task jgfs_atmos_wafs_blending_0p25
                     trigger ./jgfs_atmos_wafs_grib2_0p25 == complete
-                    time 22:25
+                    time 22:30
                 endfamily
                 family bufr_sounding
                   task jgfs_atmos_postsnd

diff --git a/ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_blending_0p25.ecf b/ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_blending_0p25.ecf
@@ -35,7 +35,7 @@ module list
 #############################################################
 export cyc=%CYC%
 export cycle=t%CYC%z
-export ICAO2023=no
+export ICAO2023=yes
 
 ############################################################
 # CALL executable job script here

diff --git a/ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_grib2.ecf b/ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_grib2.ecf
@@ -38,7 +38,7 @@ module list
 export cyc=%CYC%
 export cycle=t%CYC%z
 export USE_CFP=YES
-export ICAO2023=no
+export ICAO2023=yes
 ############################################################
 # CALL executable job script here
 ############################################################

diff --git a/ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_grib2_0p25.ecf b/ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_grib2_0p25.ecf
@@ -4,7 +4,7 @@
 #PBS -q %QUEUE%
 #PBS -A %PROJ%-%PROJENVIR%
 #PBS -l walltime=00:30:00
-#PBS -l select=1:mpiprocs=11:ompthreads=1:ncpus=11:mem=80GB
+#PBS -l select=1:mpiprocs=39:ompthreads=1:ncpus=39:mem=200GB
 #PBS -l place=vscatter
 #PBS -l debug=true
 
@@ -38,7 +38,7 @@ module list
 export cyc=%CYC%
 export cycle=t%CYC%z
 export USE_CFP=YES
-export ICAO2023=no
+export ICAO2023=yes
 ############################################################
 # CALL executable job script here
 ############################################################

diff --git a/ecf/scripts/gfs/atmos/post_processing/jgfs_atmos_wafs_gcip.ecf b/ecf/scripts/gfs/atmos/post_processing/jgfs_atmos_wafs_gcip.ecf
@@ -40,7 +40,7 @@ module list
 export cyc=%CYC%
 export cycle=t%CYC%z
 export USE_CFP=YES
-export ICAO2023=no
+export ICAO2023=yes
 
 ############################################################
 # CALL executable job script here

diff --git a/sorc/checkout.sh b/sorc/checkout.sh
@@ -87,7 +87,7 @@ if [[ ${checkout_wafs} == "YES" ]] ; then
   echo EMC_gfs_wafs checkout ...
   if [[ ! -d gfs_wafs.fd ]] ; then
     rm -f ${topdir}/checkout-gfs_wafs.log
-    git clone --recursive --branch gfs_wafs.v6.3.1 https://github.com/NOAA-EMC/EMC_gfs_wafs.git gfs_wafs.fd >> ${topdir}/checkout-gfs_wafs.log 2>&1
+    git clone --recursive --branch gfs_wafs.v6.3.2 https://github.com/NOAA-EMC/EMC_gfs_wafs.git gfs_wafs.fd >> ${topdir}/checkout-gfs_wafs.log 2>&1
     cd ${topdir}
   else
     echo 'Skip.  Directory gfs_wafs.fd already exists.'

diff --git a/versions/run.ver b/versions/run.ver
@@ -1,5 +1,5 @@
-export version=v16.3.12
-export gfs_ver=v16.3.12
+export version=v16.3.13
+export gfs_ver=v16.3.13
 export ukmet_ver=v2.2
 export ecmwf_ver=v2.1
 export nam_ver=v4.2