Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] feat: compress blobs on transfer #861

Closed
wants to merge 3 commits into from
Closed

Conversation

dignifiedquire
Copy link
Contributor

Currently broken, likely due to a bug somewhere in the asnycread/write impls of async-compression or abao

Closes #739

@dignifiedquire
Copy link
Contributor Author

Looks like our usage is simply not possible currently: Nullus157/async-compression#141

@flub
Copy link
Contributor

flub commented Mar 20, 2023

you could write a custom inner writer that doesn't pass through the closing...

we want to call shutdown to get the compressor to finish, but we don't want
to call shutdown on the underlying writer. So...
@rklaehn
Copy link
Contributor

rklaehn commented Mar 20, 2023

Can somebody enlighten me why we want to compress individual files instead of the entire stream?

@rklaehn
Copy link
Contributor

rklaehn commented Mar 21, 2023

If we do this we should do the version where the entire request is compressed as one, seee #864

@dignifiedquire
Copy link
Contributor Author

meh, closing this one

@rklaehn rklaehn deleted the feat-compression branch March 31, 2023 06:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Use lz4 compression
3 participants