v2.1: Reclaims more old accounts in clean
(backport of #4044)
#4090
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Problem
In
clean_accounts()
, if there are old storages and old accounts beyond what is expected, we do not always reclaim them. This is because when scanning the candidates duringclean
, if the account's latest slot in the slot list is not in theuncleaned_roots
list, we don't collect reclaims.This can happen if there are candidates from old/ancient slots, where their newest entry is in a slot that is not being visited by clean. We would find multiple entries for this candidate in the index, yet determine not to collect reclaims.
Summary of Changes
Collect reclaims on candidates that have slot lists greater than one entry, and if they are all cleanable (i.e. rooted).
Justification to Backport
Without this change, nodes running with
--disable-accounts-disk-index
will collect excessive storages, because startup index generation does not correctly mark duplicate pubkeys when the disk index is disabled. But now clean does go and inspect those old storages, yet it won't reclaim the old versions of the accounts because the newest version of the account is not in theuncleaned_roots
list. And because we don't reclaim these old versions, we cannot purge old storages that are all dead.(Historically the
uncleaned_roots
were all the most recent slots, so it made sense to check for the newest versions there. Now, we clean really old slots too, which means the newest version of accounts in these old slots may be elsewhere (i.e. not just in uncleaned_roots))This is an automatic backport of pull request #4044 done by [Mergify](https://mergify.com).