Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

smooth out coalescing on the powa server #16

Open
marco44 opened this issue Jun 14, 2023 · 2 comments
Open

smooth out coalescing on the powa server #16

marco44 opened this issue Jun 14, 2023 · 2 comments
Labels
enhancement New feature or request

Comments

@marco44
Copy link

marco44 commented Jun 14, 2023

In order to avoid having servers that have been created at the same time to get coalesced at the exact same time, we could just initiate the sequence for this server with its srvid. Then if you create 3 servers at the same time, they coalesce will be offset by one cycle...

@frost242
Copy link

Let's revive this issue. I didn't notice it, but I had to do the same as I went into disk space issues because of this :
powa-team/powa-archivist#80

I think this would be a great enhancement.

@frost242 frost242 added the enhancement New feature or request label Nov 27, 2024
@rjuju
Copy link
Member

rjuju commented Nov 28, 2024

I don't know how frequent your pattern is but there is clearly need for that so I agree it would be nice to do.

That being said, I don't think that simply using the srvid id would work that great in practice for your use case. The whole point of the coalesce is to benefit from compression so clearly the first dozen or few dozen of servers will do a coalesce and use resources for no disk usage gain. How about introducing a new min_coalesce or something like that and initiate the sequence to a value between that minimal value and coalesce - 1? This way it would still help avoiding a storm a coalesce (which I think was @marco44 original problem) but also still mitigate the disk usage problem you have. That combined with a connection pooler in front of the collector's repository connection and things could be quite good.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants