Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Split output filetype variable into atm and sfc #602

Merged
merged 4 commits into from
Feb 21, 2022
Merged

Split output filetype variable into atm and sfc #602

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
7297db4
Split output filetype variable into atm and sfc
WalterKolczynski-NOAA Jan 20, 2022
070a079
separate into 2 case blocks
aerorahul Jan 30, 2022
8f68eee
Set chunksize for all resolutions
WalterKolczynski-NOAA Feb 1, 2022
26ecb30
Force serial I/O for EnKF on Hera
WalterKolczynski-NOAA Feb 3, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
28 changes: 6 additions & 22 deletions parm/config/config.efcs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,12 @@ if [ $QUILTING = ".true." ]; then
export npe_efcs=$npe_fv3
fi

# Only use serial I/O for ensemble on Hera
if [[ "$machine" == "HERA" ]]; then
export OUTPUT_FILETYPE_ATM="netcdf"
export OUTPUT_FILETYPE_SFC="netcdf"
fi

# Number of enkf members per fcst job
export NMEM_EFCSGRP=2
export RERUN_EFCSGRP="NO"
Expand Down Expand Up @@ -58,28 +64,6 @@ if [ $DOIAU_ENKF = "YES" ]; then
export restart_interval="3 -1"
fi

export OUTPUT_FILETYPES="$OUTPUT_FILE"
if [[ "$OUTPUT_FILE" == "netcdf" ]]; then
export ichunk2d=0; export jchunk2d=0
export ichunk3d=0; export jchunk3d=0; export kchunk3d=0
RESTILE=$(echo $CASE_ENKF |cut -c 2-)
if [[ "$machine" == "WCOSS_DELL_P3" ]]; then
if [ $RESTILE -ge 384 ]; then
export OUTPUT_FILETYPES=" 'netcdf_parallel' 'netcdf' "
export ichunk2d=$((4*RESTILE))
export jchunk2d=$((2*RESTILE))
export ichunk3d=$((4*RESTILE))
export jchunk3d=$((2*RESTILE))
export kchunk3d=1
else
export OUTPUT_FILETYPES=" 'netcdf_parallel' 'netcdf' "
fi
fi
if [[ "$machine" == "HERA" ]]; then
export OUTPUT_FILETYPES=" 'netcdf' 'netcdf' "
fi
fi

# wave model
export cplwav=.false.

Expand Down
22 changes: 0 additions & 22 deletions parm/config/config.fcst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -203,28 +203,6 @@ export ishuffle=0
export shuffle=1
export deflate_level=1

export OUTPUT_FILETYPES="$OUTPUT_FILE"
if [[ "$OUTPUT_FILE" == "netcdf" ]]; then
export OUTPUT_FILETYPES=" 'netcdf_parallel' 'netcdf' "
export ichunk2d=0; export jchunk2d=0
export ichunk3d=0; export jchunk3d=0; export kchunk3d=0
RESTILE=$(echo $CASE |cut -c 2-)
if [[ "$machine" == "WCOSS_DELL_P3" ]]; then
if [ $RESTILE -ge 768 ]; then
export OUTPUT_FILETYPES=" 'netcdf_parallel' 'netcdf_parallel' "
export ichunk3d=$((4*RESTILE))
export jchunk3d=$((2*RESTILE))
export kchunk3d=1
fi
fi
if [[ "$machine" == "ORION" ]]; then
if [ $RESTILE -gt 192 ]; then
export OUTPUT_FILETYPES=" 'netcdf_parallel' 'netcdf_parallel' "
fi
fi
fi


#---------------------------------------------------------------------
# Disable the use of coupler.res; get model start time from model_configure
export USE_COUPLER_RES="NO"
Expand Down
21 changes: 20 additions & 1 deletion parm/config/config.fv3
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,6 @@ elif [[ "$machine" = "ORION" ]]; then
export npe_node_max=40
fi


# (Standard) Model resolution dependent variables
case $case_in in
"C48")
Expand Down Expand Up @@ -153,4 +152,24 @@ case $case_in in
;;
esac

# Calculate chunksize based on resolution
RESTILE=$(echo $case_in |cut -c2-)
export ichunk2d=$((4*RESTILE))
export jchunk2d=$((2*RESTILE))
export ichunk3d=$((4*RESTILE))
export jchunk3d=$((2*RESTILE))
export kchunk3d=1

# Determine whether to use parallel NetCDF based on resolution
case $case_in in
"C48" | "C96" | "C192")
export OUTPUT_FILETYPE_ATM="netcdf_parallel"
export OUTPUT_FILETYPE_SFC="netcdf"
;;
"C384" | "C768" | "C1152" | "C3072")
export OUTPUT_FILETYPE_ATM="netcdf_parallel"
export OUTPUT_FILETYPE_SFC="netcdf_parallel"
;;
esac

echo "END: config.fv3"
2 changes: 1 addition & 1 deletion ush/parsing_model_configure_FV3.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ write_nsflip: ${WRITE_NSFLIP:-".false."}
num_files: ${NUM_FILES:-2}
filename_base: 'atm' 'sfc'
output_grid: $OUTPUT_GRID
output_file: $OUTPUT_FILETYPES
output_file: '$OUTPUT_FILETYPE_ATM' '$OUTPUT_FILETYPE_SFC'
WalterKolczynski-NOAA marked this conversation as resolved.
Show resolved Hide resolved
ichunk2d: ${ichunk2d:-0}
jchunk2d: ${jchunk2d:-0}
ichunk3d: ${ichunk3d:-0}
Expand Down