Skip to content
This repository has been archived by the owner on Sep 21, 2023. It is now read-only.

Allow configuring multiple concurrent Elasticsearch requests via the worker parameter #150

Closed
cmacknz opened this issue Oct 31, 2022 · 1 comment

Comments

@cmacknz
Copy link
Member

cmacknz commented Oct 31, 2022

Add support for the worker configuration parameter to the shipper Elasticsearch output. Each additional worker should increase the number of concurrent requests to Elasticsearch that can be in flight.

We should strive to make the behaviour the same as the existing Beats' Elasticsearch output (https://www.elastic.co/guide/en/beats/filebeat/current/elasticsearch-output.html#_worker). Requests should be distributed to each worker randomly, as is currently done in the existing Beats outputs.

Acceptance Criteria:

  • A test exists proving that increasing the worker configuration increases the number of concurrent requests to Elasticsearch.
@cmacknz
Copy link
Member Author

cmacknz commented Oct 31, 2022

Closing as duplicate of #149

@cmacknz cmacknz closed this as completed Oct 31, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

1 participant