Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

perf(s3stream/wal): reuse the ByteBuf for record headers #1877

Merged
merged 6 commits into from
Aug 20, 2024

Conversation

Chillax-0v0
Copy link
Contributor

@Chillax-0v0 Chillax-0v0 commented Aug 20, 2024

Part of #1874

superhx
superhx previously approved these changes Aug 20, 2024
@Chillax-0v0 Chillax-0v0 marked this pull request as draft August 20, 2024 12:02
@Chillax-0v0 Chillax-0v0 marked this pull request as ready for review August 20, 2024 12:09
@ShadowySpirits ShadowySpirits merged commit 962fad3 into main Aug 20, 2024
5 checks passed
@ShadowySpirits ShadowySpirits deleted the perf-s3stream-wal-reuse-header-bytebuf branch August 20, 2024 12:15
Chillax-0v0 added a commit that referenced this pull request Aug 20, 2024
* refactor: manage the record headers' lifecycle in `Block`

Signed-off-by: Ning Yu <[email protected]>

* perf(s3stream/wal): reuse the `ByteBuf` for record headers

Signed-off-by: Ning Yu <[email protected]>

* perf: remove the max size limit

Signed-off-by: Ning Yu <[email protected]>

* test: test `FixedSizeByteBufPool`

Signed-off-by: Ning Yu <[email protected]>

* revert: "perf: remove the max size limit"

This reverts commit ed63112.

* feat: use a separate `poolSize` to limit the size of the pool

Signed-off-by: Ning Yu <[email protected]>

---------

Signed-off-by: Ning Yu <[email protected]>
Chillax-0v0 added a commit that referenced this pull request Aug 21, 2024
…1878)

* perf(s3stream/wal): reuse the `ByteBuf` for record headers (#1877)

* refactor: manage the record headers' lifecycle in `Block`

Signed-off-by: Ning Yu <[email protected]>

* perf(s3stream/wal): reuse the `ByteBuf` for record headers

Signed-off-by: Ning Yu <[email protected]>

* perf: remove the max size limit

Signed-off-by: Ning Yu <[email protected]>

* test: test `FixedSizeByteBufPool`

Signed-off-by: Ning Yu <[email protected]>

* revert: "perf: remove the max size limit"

This reverts commit ed63112.

* feat: use a separate `poolSize` to limit the size of the pool

Signed-off-by: Ning Yu <[email protected]>

---------

Signed-off-by: Ning Yu <[email protected]>

* perf: increase the size of the buffer pool as CPU cores

Signed-off-by: Ning Yu <[email protected]>

---------

Signed-off-by: Ning Yu <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants