Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Maximum Message Size #44

Closed
petersilva opened this issue Jun 9, 2021 · 1 comment
Closed

Maximum Message Size #44

petersilva opened this issue Jun 9, 2021 · 1 comment
Labels
Decision Documents a commitee agreement or choice

Comments

@petersilva
Copy link
Contributor

None of the MQP message protocols define a maximum message size, but message queuing brokers are optimized for small messages. Brokers of all MQP achieve their highest performance forwarding many small messages, rather than few large ones. Even rare Large messages can have an outsized effect on performance by requiring buffers on brokers to expand for those rare cases, so keeping messages are uniformly "small" is necessary for best performance.

The renewal of MQP protocol usage in GTS aims to have only announcements of products, not to transport the data itself, which is a particularly easy way to get smaller messages. However, many people with long experience with other messaging protocols expect the old methods, where products themselves were included in the files ( examples #36 ) and the Aviation people seem to want data to be included in the body as well. This is unlikely to scale well.

The aviation people have mentioned 8MB as a maximum product size for aviation. We believe that, whatever method is adopted by other groups, they will eventually find themselves wanting to send products larger than the maximum, and will eventually be faced with two choices: either they add support for links to data, as we have already done, or they introduce segmentation. Having that choice happen at a large message size is likely worse for performance.

The old GTS 386 limit was 500,000 bytes, which already sounds relatively large. That's already a high number in my view, but I think the committee was interested in doing some performance studies before settling on a recommendation. So this is a placeholder for now.

@petersilva petersilva added the Decision Documents a commitee agreement or choice label Feb 17, 2022
@petersilva
Copy link
Contributor Author

notification format no longer our concern. If someone wants to open an issue in here:
https://github.com/wmo-im/wis2-notification-message

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Decision Documents a commitee agreement or choice
Projects
None yet
Development

No branches or pull requests

1 participant