Skip to content
This repository has been archived by the owner on Sep 18, 2024. It is now read-only.

Synchronous commits? #1

Open
kevinmichaelchen opened this issue May 13, 2020 · 0 comments
Open

Synchronous commits? #1

kevinmichaelchen opened this issue May 13, 2020 · 0 comments

Comments

@kevinmichaelchen
Copy link
Member

Should we synchronously commit (topic, partition, offset) after reading each Kafka record? If we don't, suppose we read and process messages 1, 2, and 3 concurrently, and the middle one fails, and then the reader does its periodic commit. The offset will be set to 4, even though 2 failed...

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant