Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Auto-compress snapshots and load compressed snapshots #1168

Open
matthewdarwin opened this issue May 12, 2023 · 0 comments
Open

Auto-compress snapshots and load compressed snapshots #1168

matthewdarwin opened this issue May 12, 2023 · 0 comments
Labels
discussion enhancement New feature or request

Comments

@matthewdarwin
Copy link

Looking at WAX, for example a snapshot original_size = 21960.4 MiB compressed_size with zstd = 3954.6 MiB It would be great if nodeos compressed the snapshot when writing to disk to save extra i/o.

Various different people have chosen different compression standards for snapshots which makes it hard to build interoperable tools. Having nodeos work with a compression tech directly would enforce consistency by default. I like zstd. On the other hand zlib is already included in nodeos.

This will help a lot on AWS or other cloud providers where I/O is very restricted.

Originally: eosnetworkfoundation/mandel#73

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
discussion enhancement New feature or request
Projects
Status: Todo
Development

No branches or pull requests

3 participants