Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gazette: Implement journal::append() #1856

Merged
merged 1 commit into from
Jan 15, 2025
Merged

Conversation

jshearer
Copy link
Contributor

@jshearer jshearer commented Jan 7, 2025

Description:

This implements low-level appends to Gazette. It takes a function that generates a stream of Bytes, and attempts to drive an append RPC. If the RPC errors, you can retry by re-polling after recieving an Error.

Pulled out of my Dekaf work in #1840 for better reviewability.


This change is Reviewable

@jshearer jshearer requested a review from jgraettinger January 7, 2025 23:32
@jshearer jshearer force-pushed the jshearer/gazette_appends branch from aa21266 to fb318a8 Compare January 7, 2025 23:34
crates/gazette/src/journal/append.rs Outdated Show resolved Hide resolved
crates/gazette/src/journal/append.rs Outdated Show resolved Hide resolved
crates/gazette/src/lib.rs Outdated Show resolved Hide resolved
@jshearer jshearer force-pushed the jshearer/gazette_appends branch from cc7c66f to 47804cd Compare January 10, 2025 16:00
@jshearer jshearer changed the title gazette: Implement append_stream and friends gazette: Implement journal::append() Jan 10, 2025
@jshearer
Copy link
Contributor Author

Alright @jgraettinger, want to take another look?

@jshearer jshearer requested a review from jgraettinger January 10, 2025 20:03
@jshearer jshearer force-pushed the jshearer/gazette_appends branch from 47804cd to 0e076da Compare January 10, 2025 20:13
Copy link
Member

@jgraettinger jgraettinger left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM % some nits below. Thanks

Cargo.toml Show resolved Hide resolved
crates/gazette/src/journal/append.rs Outdated Show resolved Hide resolved
crates/gazette/src/journal/append.rs Outdated Show resolved Hide resolved
crates/gazette/src/journal/append.rs Outdated Show resolved Hide resolved
This implements low-level appends to Gazette. It takes a function that generates a stream of `Bytes`, and attempts to drive an append RPC. If the RPC errors, you can retry by re-polling after recieving an Error.
@jshearer jshearer force-pushed the jshearer/gazette_appends branch from 0e076da to 84b6437 Compare January 14, 2025 17:05
@jshearer jshearer merged commit fd37897 into master Jan 15, 2025
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants