This repository has been archived by the owner on Nov 15, 2023. It is now read-only.
kvdb-rocksdb overlay cache is not effective #4508
Labels
I9-optimisation
An enhancement to provide better overall performance in terms of time-to-completion for a task.
Seems that cache in kvdb itself (memorizing raw key-value pairs on write), despite showing effectiveness in synthetic benchmarks, offers no performance advantage for sync speed, sometimes even negative (anybody can try run polkadot it with
parity-common
replaced from this branch https://github.com/paritytech/parity-common/tree/no-overlay). Not counting increased memory footprint.This is probably due to:
Given that, and also the fact that this cache prevents other possible optimisations (such as zero(little)-copy database transactions), we might want to remove it.
There are probably considerations other than sync speed, which would be great to hear about.
The text was updated successfully, but these errors were encountered: