Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

goleveldb: ForceCompact #216

Merged
merged 6 commits into from
Feb 8, 2022
Merged

goleveldb: ForceCompact #216

merged 6 commits into from
Feb 8, 2022

Conversation

tac0turtle
Copy link
Contributor

No description provided.

@codecov
Copy link

codecov bot commented Feb 7, 2022

Codecov Report

Merging #216 (35392b4) into master (ce3673b) will decrease coverage by 0.06%.
The diff coverage is 0.00%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #216      +/-   ##
==========================================
- Coverage   68.57%   68.51%   -0.07%     
==========================================
  Files          27       27              
  Lines        2126     2128       +2     
==========================================
  Hits         1458     1458              
- Misses        593      595       +2     
  Partials       75       75              
Impacted Files Coverage Δ
goleveldb.go 58.91% <0.00%> (-0.93%) ⬇️
Impacted Files Coverage Δ
goleveldb.go 58.91% <0.00%> (-0.93%) ⬇️

Copy link
Contributor

@creachadair creachadair left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The change seems fine, but it would be helpful if the description gave a bit of context for why this is necessary.

@tac0turtle
Copy link
Contributor Author

yes, in the sdk and tendermint we Call delete on the db but with lam trees the space on disk is not reclaimed until compaction is completed, in our environment we write so often the db doesn't have enough time to sufficiently compact itself. By adding force compact I have two things planned, in the short term I wrote a tool that prunes blocks, state and app state then calls force compact on the entire db. With this tool, after pruning the stores I would need to compact it. In the mid term id like to add force compacting to the sdk to avoid seekcompaction on goleveldb.

The overall goal is optimisations with this. It allows the application to control compaction instead of passing it on to the default settings of the db

@tac0turtle tac0turtle merged commit 9ea19a1 into tendermint:master Feb 8, 2022
@tac0turtle tac0turtle deleted the compact branch February 8, 2022 17:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants