feat(chain follower): Updated chain follower to add mithril auto download and chain integrity checks #266
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
… auto mithril sync to follower logic.
…we can only have at most 3. Simplifies logic significantly.
…updating the snapshot.
…for the next snapshot.
… longer possible.
…dule (#310) * feat: data index test * feat: test index db simple * feat: stats * fix: minor imports * feat: snapshot config * feat: follow
* feat(wip): implement decode for metadata * fix: update dependency * fix: update metadata decoder * fix: update c509 branch * fix: metadata decode * fix: doc and implementation * fix: add array support for type any * fix: spelling and typo * fix: typo * fix: linter * fix: clean up + add test
…mentation for the cardano ledger format.
…ermes into feat/auto-sync-mithril
…heck not working.
* feat: extract witness from tx * fix: format * fix: add word to dic * fix: add witness to block data and add utils file * fix: add babbage block test * fix: new babbage block + fix name * fix: update babbage block data * fix: babbage block data slot 67749703 * fix: move utils blake * fix: cargo toml * fix: update test data
…t and validate it (#325) * feat: try count and halt on error * fix: tmp aria2c * feat: test downloader target * feat: downloaded snapshot caching in earthly * fix: remove echo in the execute command * feat: remove view cache size command
…net has sync issues.
…o crash the app its running with.
* fix(hermes-lib): Don't have any option that lets the chain follower to crash the app its running with. * fix(hermes-lib): Fix code format * fix(hermes-lib): wip fix sync for mainnet and preprod and preview * fix(hermes-lib): Fix origin sync to work on preprod as well as mainnet * fix(hermes-lib): Make network use strum derived implementations properly * fix(hermes-lib): Fix comparison of aggregator to required network * fix(hermes-lib): Return proper error types * fix(hermes-lib): Silence CIP32 debug message
) * feat: test decode purpose * fix: multi era block test on origin point * feat: nonce test * feat: voting key decode * feat: decode stake pub * feat: payment address * feat: error cases * chore: remove comment --------- Co-authored-by: Steven Johnson <[email protected]>
* fix(hermes-lib): Don't have any option that lets the chain follower to crash the app its running with. * fix(hermes-lib): Fix code format * fix(hermes-lib): wip fix sync for mainnet and preprod and preview * fix(hermes-lib): Fix origin sync to work on preprod as well as mainnet * fix(hermes-lib): Make network use strum derived implementations properly * fix(hermes-lib): Fix comparison of aggregator to required network * fix(hermes-lib): Return proper error types * fix(hermes-lib): Silence CIP32 debug message * feat(hermes-lib): wip * feat(hermes-lib): Parallel Downloader has configurable http connections * fix(hermes-lib): update dependencies * fix(hermes-lib): Make download fully sync, and simplify re-order queuing * fix(hermes-lib): Remove obsoleted commented out code * fix(hermes-lib): Fix DL stats * fix(hermes-lib): SkipMap/List exhibit memory leak type behavior. Eliminate SkipMap where possible. * fix(hermes-lib): More memory leak work. Remove SkipSet and make sure workers are stopping properly when they are done. * fix(hermes-lib): revert the defaults back to conservative values * fix(hermes-lib): Allow tuning the download resources from command line * fix(hermes-lib): Demonstrate syncing preprod with different bandwidth/memory usage tradeoffs. * fix(hermes-lib): Allow the previous snapshot to be valid as well as current on recovery, and fix dedup. * fix(hermes-lib): Fix code format and merge issue with example cli arguments
…ermes into feat/auto-sync-mithril
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This is a huge update to the Chain Follower.
It includes code to automatically fetch mithril snapshots for any running chain and to validate the blockchain integrity as it follows the chain.
Data lookup should be very fast for any arbitrary block, and sync times should also be very fast compared to any other solution.
Related Issue(s)
Description of Changes
Breaking Changes
The entire API surface has changed and is a large breaking change.
Screenshots
Related Pull Requests
Please confirm the following checks