Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automatically upload precomputed blocks to object storage #23

Open
trevorbernard opened this issue Oct 6, 2023 · 5 comments
Open

Automatically upload precomputed blocks to object storage #23

trevorbernard opened this issue Oct 6, 2023 · 5 comments
Assignees
Labels
enhancement New feature or request

Comments

@trevorbernard
Copy link
Contributor

Run a Mina node and log the precomputed blocks into a bucket we control. E.g. S3 Bucket

@trevorbernard trevorbernard added the enhancement New feature or request label Oct 6, 2023
@Isaac-DeFrain
Copy link
Member

Just need to resolve merge conflicts MinaProtocol/mina#13236. However, this solution will only allow us to get blocks in the transition frontier. Hosting a bucket of all precomputed blocks is another story altogether.

@robinbb
Copy link
Member

robinbb commented Mar 15, 2024

@Isaac-DeFrain My interpretation of this issue is that it is about the hosting of a precomputed blocks bucket. I'll take it.

@robinbb robinbb self-assigned this Mar 15, 2024
@robinbb
Copy link
Member

robinbb commented Mar 20, 2024

https://granola-mina-blocks.se-sto-1.linodeobjects.com is now where we host our (corrected) block files. Also, we do not use gsutil to download blocks in our regression suite.

A final step is to create a Mina node that uploads blocks to the bucket in an automated fashion.

@jhult
Copy link
Member

jhult commented Mar 21, 2024

Related to Granola-Team/mina-indexer#609

@robinbb robinbb removed this from the MinaExplorer.com Equivalence milestone Apr 4, 2024
@jhult jhult changed the title Problem: We rely on O(1)'s precomputed blocks bucket Automatically upload precomputed blocks to object storage May 9, 2024
@robinbb robinbb transferred this issue from Granola-Team/mina-indexer Jun 16, 2024
@jhult
Copy link
Member

jhult commented Jan 31, 2025

https://blocks.minasearch.com now points to our object storage. You cannot list the files (using your browser), but if you know a block heigh and state hash, you can download the file (using stand HTTP).

Example: https://blocks.minasearch.com/mainnet-417740-3NLJ6bJH4QQhjqegTiZbo138V1TX1KxBrNhqAMzMDrnGoaN6QPVW.json

P.S. rclone still has the ability to list/locate all the files in the bucket.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Blocked
Development

No branches or pull requests

4 participants