Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Code table 1.4, 4.3 and 4.6: Adding new entries to better describe type of forecasting #249

Closed
sebvi opened this issue May 2, 2024 · 6 comments · Fixed by #261
Closed
Assignees
Milestone

Comments

@sebvi
Copy link
Contributor

sebvi commented May 2, 2024

Initial request

In the context of several, related developments, ECMWF is requesting new entries in several code table to support the new products.

For data which have the only purpose to demonstrate the data layout, for example as demo data for new templates proposed in a WMO Fast-track, we request a new entry for identifying sample data in code table 1.4. In the same table, EWCMWF is also requesting a specific entry to clearly label Machine learning based products.

Different forecast products with forecast skills on different forecast horizons are combined and weighted to produce a seamless composite forecast product. In this context, ECMWF is requesting a new entry "blended forecasts" in code table 4.3.

Finally, ECMWF is proposing to extend code table 4.6 with new entries to facilitate the identification of the different type of peturbations to produce perturbed forecasts.

Amendment details

ADD to code table 1.4 Type of data

Code Description
9 Experimental data (see Note)
10 ML based forecast (see Note)

Note: 9 – Data for demonstrational purposes only; 10 – forecast from Machine Learning (ML) model.

ADD to code table 4.3 Type of generating process

Code Description
22 Blended forecast (see note)

Note: Combination of different forecast products to produce a smooth, continuous forecast by applying weights to each individual prediction system which depend on the lead time and forecast skill (e.g. seamless prediction using nowcasting to short-range to medium-range).

ADD to code table 4.6 Type of ensemble forecast

Code Description
5 Unperturbed forecast
6 Perturbed forecast
7 Initial conditions perturbations (see Note)
8 Model physics perturbations (see Note)
9 Initial conditions + model physics perturbations (see Note)

Note: 7 – Ensemble members are initialised from different initial conditions; 8 – model physics are perturbed e.g., with methods like SPPT, SPP, SKEB, etc.; 9 – combination of 7and 8.

Comments

No response

Requestor(s)

Sebastien Villaume (ECMWF)
Robert Osinski (ECMWF)

Stakeholder(s)

ECMWF

Publication(s)

Manual on Codes (WMO-No. 306), Volume I.2, GRIB code table 1.4 (update)
Manual on Codes (WMO-No. 306), Volume I.2, GRIB code table 4.3 (update)
Manual on Codes (WMO-No. 306), Volume I.2, GRIB code table 4.6 (update)

Expected impact of change

LOW

Collaborators

No response

References

No response

Validation

No response

@sebvi sebvi changed the title Code table 1.4, 4.3 and 4.6: Adding new entries to better describer type of forecasting Code table 1.4, 4.3 and 4.6: Adding new entries to better describe type of forecasting May 2, 2024
@amilan17 amilan17 added this to the FT2024-2 milestone May 2, 2024
@sebvi sebvi self-assigned this May 14, 2024
@amilan17
Copy link
Member

amilan17 commented May 14, 2024

https://github.com/wmo-im/CCT/wiki/Teleconference.14.May.2024 notes:
Sebastien introduced the proposal; @sebvi change sample data to experimental data;

@sebvi
Copy link
Contributor Author

sebvi commented Jun 24, 2024

proposal updated to use "experimental data". Branch created and updated

@amilan17
Copy link
Member

https://github.com/wmo-im/CCT/wiki/Teleconference.24and26.June.2024 notes:
branch is ready for validation;

@amilan17
Copy link
Member

amilan17 commented Jul 8, 2024

@sebvi I think the branch has not been updated for 'experimental' and the notes are missing.

@amilan17
Copy link
Member

@sebvi I added the notes and changed sample to example.

amilan17 added a commit that referenced this issue Aug 8, 2024
…e of forecasting (#261)

#249 
* fix rebase conflict: 249 adding entries in code table 1.4, 4.3 and 4.6 with associated notes

* fix rebase of xml,txt files

* #249, add notes, change sample to example

* xml,txt files

* editorial, changed 23 to 22 in CF4.3

* xml,txt files

* Update GRIB2_CodeFlag_4_6_CodeTable_en.csv

Co-authored-by: Marijana Crepulja <[email protected]>

* xml,txt files

---------

Co-authored-by: Sebastien Villaume <[email protected]>
Co-authored-by: Enrico Fucile <[email protected]>
Co-authored-by: Marijana Crepulja <[email protected]>
@sebvi
Copy link
Contributor Author

sebvi commented Aug 8, 2024

I don't see your changes in my copy of the branch after pulling it

amilan17 added a commit that referenced this issue Aug 9, 2024
@amilan17 amilan17 mentioned this issue Aug 9, 2024
amilan17 added a commit that referenced this issue Aug 9, 2024
* Code table 1.4, 4.3 and 4.6: Adding new entries to better describe type of forecasting #249

* xml,txt files

---------

Co-authored-by: Enrico Fucile <[email protected]>
@amilan17 amilan17 moved this to Ready for FT Approval Procedure in GRIB2 Amendments Aug 22, 2024
amilan17 added a commit that referenced this issue Nov 7, 2024
* xml,txt files

* 247 code table 49 add an entry to encode a probability based on a quantile distribution instead of based on a threshold (#265)

* fix rebase conflict xml,txt files

* fix rebase conflicts 247 adding entry in COde table 4.9 and associated note

* fix rebase conflicts xml,txt files

* xml,txt files

* #247 changing PDF acronym to probability distribution function

* xml,txt files

* remove odd char

* xml,txt files

* xml,txt files

* remove datestamp from XML gen

* xml,txt files

---------

Co-authored-by: Enrico Fucile <[email protected]>
Co-authored-by: Sebastien Villaume <[email protected]>

* 253 new normal and tangential velocity.... (#270)

* xml,txt files

* xml,txt files

* issue #253 update branch

* xml,txt files

* Update GRIB2_CodeFlag_4_2_10_4_CodeTable_en.csv

53 and 54 for normal and tangential component of water velocity, as entry 52 is used in issue 244 for mixed layed depth.

* xml,txt files

---------

Co-authored-by: Enrico Fucile <[email protected]>
Co-authored-by: Sibylle Krebber <[email protected]>

* 248 code table 4101 new entry in code table 4101 to extend the usage of templates 4105 4106 4107 and 4112 (#263)

* fix rebase conflict: 248 adding entry in Code Table 4.101 and associated note

* fix rebase of xml,txt files

* fix legacy conflict text

* xml,txt files

---------

Co-authored-by: Sebastien Villaume <[email protected]>
Co-authored-by: Enrico Fucile <[email protected]>

* 244 new new mixed layer depth parameter in code table 42 discipline 10 1 (#262)

* issue #244 in NEW branch

* xml,txt files

* xml,txt files

---------

Co-authored-by: Enrico Fucile <[email protected]>

* 246 additional anomalies templates (#268)

* #246 adding template 4.128 to 4.136 and entries in code table 4.0

* rebase fix xml,txt files

* Update GRIB2_Template_4_129_ProductDefinitionTemplate_en.csv

Replace "to" with "-"

* xml,txt files

* Update GRIB2_Template_4_131_ProductDefinitionTemplate_en.csv

upper limit

* xml,txt files

* Update GRIB2_Template_4_134_ProductDefinitionTemplate_en.csv

"51-62" not as octetNo

* xml,txt files

* Update GRIB2_Template_4_136_ProductDefinitionTemplate_en.csv

upper limit and typo in line 47

* xml,txt files

* fix CSV

* xml,txt files

* Apply suggestions from code review

update see note references

* xml,txt files

---------

Co-authored-by: Sebastien Villaume <[email protected]>
Co-authored-by: Enrico Fucile <[email protected]>
Co-authored-by: Sibylle Krebber <[email protected]>

* 245 deprecate template 444 create rectified version as template 450 (#269)

* #245 deprecate template 4.44, create new corrected template 4.50 and update Code table 4.0 accordingly

* xml,txt files

* Update GRIB2_CodeFlag_4_0_CodeTable_en.csv

* xml,txt files

* Update GRIB2_Template_4_50_ProductDefinitionTemplate_en.csv

* xml,txt files

---------

Co-authored-by: Sebastien Villaume <[email protected]>
Co-authored-by: Enrico Fucile <[email protected]>

* 250 code table 42 and 4238 new sourcesink entries in code table 4238 and a new parameter in code table 42 discipline 0 category 20 (#274)

* #250 adding entries in code table 4.22.0.20 and 4.238

* xml,txt files

* #250 updating entries to only keep sink and source (removing loss and gain)

* xml,txt files

* xml,txt files

* xml,txt files

---------

Co-authored-by: Sebastien Villaume <[email protected]>
Co-authored-by: Enrico Fucile <[email protected]>

* 238 new precipitation type flag... (#267)

#238

* xml,txt files

* 271 remove date from xml script (#272)

* xml,txt files

* Update create_master_lists.py

Remove the generation of the 'generated' param to avoid complex merging process.

Now the xml header won't have the 'generated' param anymore

* xml,txt files

---------

Co-authored-by: Enrico Fucile <[email protected]>

* xml,txt files

* xml,txt files

* update branch for issue #238

* xml,txt files

---------

Co-authored-by: Enrico Fucile <[email protected]>
Co-authored-by: antoineMerleEUM <[email protected]>

* 249 code table 14 43 and 46 adding new entries to better describe type of forecasting (#261)

#249 
* fix rebase conflict: 249 adding entries in code table 1.4, 4.3 and 4.6 with associated notes

* fix rebase of xml,txt files

* #249, add notes, change sample to example

* xml,txt files

* editorial, changed 23 to 22 in CF4.3

* xml,txt files

* Update GRIB2_CodeFlag_4_6_CodeTable_en.csv

Co-authored-by: Marijana Crepulja <[email protected]>

* xml,txt files

---------

Co-authored-by: Sebastien Villaume <[email protected]>
Co-authored-by: Enrico Fucile <[email protected]>
Co-authored-by: Marijana Crepulja <[email protected]>

* Update notes/CodeFlag_notes.csv

* 251 code table 41 and 42 new category for thermodynamical properties in discipline land surface and associated parameters (#266)

* #251 adding entries in subtables of codec table 4.2

* fix rebase conflicts for xml,txt files

* change capitilization

* xml,txt files

* #251 add notes

* xml,txt files

* Update GRIB2_CodeFlag_4_2_0_4_CodeTable_en.csv

add note number

* xml,txt files

* Update GRIB2_CodeFlag_4_2_0_4_CodeTable_en.csv

change note number again

* xml,txt files

---------

Co-authored-by: Sebastien Villaume <[email protected]>
Co-authored-by: Enrico Fucile <[email protected]>

* 249 new2 (#275)

* Code table 1.4, 4.3 and 4.6: Adding new entries to better describe type of forecasting #249

* xml,txt files

---------

Co-authored-by: Enrico Fucile <[email protected]>

---------

Co-authored-by: Enrico Fucile <[email protected]>
Co-authored-by: Sebastien Villaume <[email protected]>
Co-authored-by: Sibylle Krebber <[email protected]>
Co-authored-by: antoineMerleEUM <[email protected]>
Co-authored-by: Marijana Crepulja <[email protected]>
@amilan17 amilan17 closed this as completed Nov 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

Successfully merging a pull request may close this issue.

2 participants