Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get fee recommendation from mempool space #1302

Merged
merged 5 commits into from
Oct 9, 2024

Conversation

ercecan
Copy link
Member

@ercecan ercecan commented Oct 8, 2024

Description

Mempool space fee estimation

Linked Issues

Copy link
Contributor

@kpp kpp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lgtm but maybe this url should be set via config?

crates/bitcoin-da/src/service.rs Outdated Show resolved Hide resolved
Copy link

codecov bot commented Oct 8, 2024

Codecov Report

Attention: Patch coverage is 97.67442% with 1 line in your changes missing coverage. Please review.

Project coverage is 77.4%. Comparing base (b156b08) to head (dd5102e).
Report is 2 commits behind head on nightly.

Files with missing lines Patch % Lines
crates/bitcoin-da/src/service.rs 97.6% 1 Missing ⚠️
Additional details and impacted files
Files with missing lines Coverage Δ
crates/bitcoin-da/src/service.rs 51.4% <97.6%> (+2.4%) ⬆️

... and 2 files with indirect coverage changes

@eyusufatik eyusufatik merged commit d8708de into nightly Oct 9, 2024
14 checks passed
@eyusufatik eyusufatik deleted the erce/mempoolspace-recommend-fee branch October 9, 2024 11:57
eyusufatik added a commit that referenced this pull request Oct 9, 2024
* Structured concurrency: Part 1 (#1214)

* Implement managed tasks for SubscriptionManager

* Fix clippy

* Add comment about trace task

* Use broadcast instead of mpsc for l2 blocks events

* Fix typo (#1246)

* Structured Concurrency: Part 2 (#1216)

* Implement managed tasks for SubscriptionManager

* Fix clippy

* Add comment about trace task

* Use broadcast instead of mpsc for l2 blocks events

* Fix spawns in DaService

* Add TaskManager

* Use task manager in sequencer

* Document TaskManager

* Handle shutdown event

* Use TaskTracker

* Add comment about using a cancellation token

* Use JoinHandles instead of TaskTracker

* Use TaskManager in fullnode and prover

* Improve bitcoin-da service

* Force spawned tasks to accept a cancellation token

* Use biased polling

* Satisfy clippy

* Address PR feedback

* Fix checks

* Pin foundry (#1253)

* Pin foundary

* Add comment

* Remove puclihs mock da block script

* Use default block time on error (#1244)

* Use default block time on error

* Constant target_block_time

* Remove import

* Dump logs and cleanup on assert failures (#1252)

* Fix estiamte gas l1 fee issue when metamask max amount is selected (#1261)

* Fix estiamte gas l1 fee issue when metamask max amount is selected

* Fix tests

* Remove unnecessary comment

* Fix hive (#1263)

* Fix configs

* Remove publish mock block from docker

* Update port for hive

* Rename config in hive

* Refactor eth estimate gas l1 fee issue (#1264)

* Refactor eth estimate gas l1 fee issue

* Nits

* Fix bug

* Refactor

* Do not ignore resources

* Fix

---------

Co-authored-by: Roman Proskuryakoff <[email protected]>

* Pruning skeleton (#1229)

* Implement managed tasks for SubscriptionManager

* Fix clippy

* Add comment about trace task

* Use broadcast instead of mpsc for l2 blocks events

* Fix spawns in DaService

* Add TaskManager

* Use task manager in sequencer

* Document TaskManager

* Handle shutdown event

* Use TaskTracker

* Add comment about using a cancellation token

* Use JoinHandles instead of TaskTracker

* Use TaskManager in fullnode and prover

* Improve bitcoin-da service

* Force spawned tasks to accept a cancellation token

* Use biased polling

* Satisfy clippy

* WIP

* Add pruning tables

* Pruning skeleton implementation

* Use pruner in nodes

* Use biased polling based on order

* WIP

* Fix how config is done

* Derive default

* Add logs

* Let the tasks finish without panicing

* Use pruning config in fullnode and prover

* Add simple run test

* Use option instead of PruningMode

* Unneccessary changes

* l2_receiver

* Cleanup prints

* Use last pruned block in calculation

* Implement pruning criteria

* Lint and add comment

* Set the last_pruned_block to up_to_block value

* Don't store config internally

* Remove from constructor

* Should not change

* Move config value

* Remove pruning from sequencer / prover

* Derive SequencerClient (#1269)

* Derive SequencerClient

* Renames

* Lint

* Improve estimate gas and create access list rpcs (#1265)

* Remove unnecessary transact_to conversion

* unwrap_or_default

* More concise block_env initialization

* Actually get highest gas limit from request and block env

* One liner set

* Allow unused

* Cleanup prepare_call_env

* Fix tests & lint

* Replace unwrap

* Set state to block in eth_call

* Consume request in prepare_call_env

* Lint

* Set state before reading config

* Remove unnecessary clone

* Replace allow unused with feature native gate

* Add sys txs to evm tests (#1255)

* modify config_push_contracts

* modify call_multiple_test

* modify tests in call_tests.rs

* moving common functions to utils.rs

* minor fixes

* updated lock files

* modify tests

---------

Co-authored-by: Esad Yusuf Atik <[email protected]>

* make prover config arg not optional (#1278)

* Pin to 27.1 (#1279)

* E2E tests using citrea-e2e (#1277)

* E2E tests using citrea-e2e

* Lint

* Set CITREA path

* With github.workspace

* Target citrea-e2e main

* Update citrea-e2e rev

* Use debug build

* Update citrea-e2e

* Prover generate input rpc (#1280)

* WIP Implement prover generate rpcg

* It compiles but stf is modified

* Context

* Fix Context: Send

* Merge fix

* Move function from common to prover

* Remove code duplicate and unnecessary log

* Add optional parameter to break commitments into groups

* Return input as string

---------

Co-authored-by: Roman Proskuryakoff <[email protected]>

* Move node configs to citrea-common (#1286)

* move node configs to a seperate crate

* fix udeps

* remove native feature

* move SequencerConfig

* move config to citrea-common

* fix use statements

* Update e2e test framework and fix tests (#1305)

* Update e2e test framework and fix tests

* Fix bug

* Update ci binary env key

* Test if new fix works

* Update bitcoincore-rpc version

* Dprint

* Try against fix prover config rev

* Target main HEAD rev

---------

Co-authored-by: jfldde <[email protected]>

* build and publish a new image for every commit to the nightly branch (#1309)

* Get fee recommendation from mempool space (#1302)

* Get fee recommendation from mempool space

* Fix bug

* Construct mempool space endpoint by network

---------

Co-authored-by: Esad Yusuf Atik <[email protected]>

* new path fix for nightly (#1310)

* Enable pending block tag in simulation endpoints (#1303)

* treat pending tag same as latest

* fix lint

* return new sealed block for pending

* handle pending tag externally

* revert enabling pending in some endpoints

* get blockenv instead of sealed block

* address review comments

* implement tests for eth_call, eth_estimateGas, eth_createAccessList pending blocks

* rename tests

---------

Co-authored-by: eyusufatik <[email protected]>

* Implement state and block overrides (#1270)

* Implement state and block overrides

* Update comment

* apply_block_overrides func

* apply_state_overrides func

* Use a single func for replacing account storage

* Clippy

* Address feedback

Use Reth's BlockOverrides with saturating_to to convert back to u64

* Test for block overrides

* Test for state overrides

* Comment tests

* Create a fresh working set

* Remove box

* remove alloy-serde

---------

Co-authored-by: eyusufatik <[email protected]>

* Use spawn_blocking for da queue (#1311)

* Fetch smart fee only if none (#1312)

* update run doc and changelog (#1315)

---------

Co-authored-by: Rakan Al-Huneiti <[email protected]>
Co-authored-by: Ahmet Yazıcı <[email protected]>
Co-authored-by: Erce Can Bektüre <[email protected]>
Co-authored-by: jfldde <[email protected]>
Co-authored-by: Erce Can Bektüre <[email protected]>
Co-authored-by: Roman Proskuryakoff <[email protected]>
Co-authored-by: Ege Okan Ünaldı <[email protected]>
Co-authored-by: Çetin <[email protected]>
eyusufatik added a commit that referenced this pull request Oct 9, 2024
* Structured concurrency: Part 1 (#1214)

* Implement managed tasks for SubscriptionManager

* Fix clippy

* Add comment about trace task

* Use broadcast instead of mpsc for l2 blocks events

* Fix typo (#1246)

* Structured Concurrency: Part 2 (#1216)

* Implement managed tasks for SubscriptionManager

* Fix clippy

* Add comment about trace task

* Use broadcast instead of mpsc for l2 blocks events

* Fix spawns in DaService

* Add TaskManager

* Use task manager in sequencer

* Document TaskManager

* Handle shutdown event

* Use TaskTracker

* Add comment about using a cancellation token

* Use JoinHandles instead of TaskTracker

* Use TaskManager in fullnode and prover

* Improve bitcoin-da service

* Force spawned tasks to accept a cancellation token

* Use biased polling

* Satisfy clippy

* Address PR feedback

* Fix checks

* Pin foundry (#1253)

* Pin foundary

* Add comment

* Remove puclihs mock da block script

* Use default block time on error (#1244)

* Use default block time on error

* Constant target_block_time

* Remove import

* Dump logs and cleanup on assert failures (#1252)

* Fix estiamte gas l1 fee issue when metamask max amount is selected (#1261)

* Fix estiamte gas l1 fee issue when metamask max amount is selected

* Fix tests

* Remove unnecessary comment

* Fix hive (#1263)

* Fix configs

* Remove publish mock block from docker

* Update port for hive

* Rename config in hive

* Refactor eth estimate gas l1 fee issue (#1264)

* Refactor eth estimate gas l1 fee issue

* Nits

* Fix bug

* Refactor

* Do not ignore resources

* Fix

---------

Co-authored-by: Roman Proskuryakoff <[email protected]>

* Pruning skeleton (#1229)

* Implement managed tasks for SubscriptionManager

* Fix clippy

* Add comment about trace task

* Use broadcast instead of mpsc for l2 blocks events

* Fix spawns in DaService

* Add TaskManager

* Use task manager in sequencer

* Document TaskManager

* Handle shutdown event

* Use TaskTracker

* Add comment about using a cancellation token

* Use JoinHandles instead of TaskTracker

* Use TaskManager in fullnode and prover

* Improve bitcoin-da service

* Force spawned tasks to accept a cancellation token

* Use biased polling

* Satisfy clippy

* WIP

* Add pruning tables

* Pruning skeleton implementation

* Use pruner in nodes

* Use biased polling based on order

* WIP

* Fix how config is done

* Derive default

* Add logs

* Let the tasks finish without panicing

* Use pruning config in fullnode and prover

* Add simple run test

* Use option instead of PruningMode

* Unneccessary changes

* l2_receiver

* Cleanup prints

* Use last pruned block in calculation

* Implement pruning criteria

* Lint and add comment

* Set the last_pruned_block to up_to_block value

* Don't store config internally

* Remove from constructor

* Should not change

* Move config value

* Remove pruning from sequencer / prover

* Derive SequencerClient (#1269)

* Derive SequencerClient

* Renames

* Lint

* Improve estimate gas and create access list rpcs (#1265)

* Remove unnecessary transact_to conversion

* unwrap_or_default

* More concise block_env initialization

* Actually get highest gas limit from request and block env

* One liner set

* Allow unused

* Cleanup prepare_call_env

* Fix tests & lint

* Replace unwrap

* Set state to block in eth_call

* Consume request in prepare_call_env

* Lint

* Set state before reading config

* Remove unnecessary clone

* Replace allow unused with feature native gate

* Add sys txs to evm tests (#1255)

* modify config_push_contracts

* modify call_multiple_test

* modify tests in call_tests.rs

* moving common functions to utils.rs

* minor fixes

* updated lock files

* modify tests

---------

Co-authored-by: Esad Yusuf Atik <[email protected]>

* make prover config arg not optional (#1278)

* Pin to 27.1 (#1279)

* E2E tests using citrea-e2e (#1277)

* E2E tests using citrea-e2e

* Lint

* Set CITREA path

* With github.workspace

* Target citrea-e2e main

* Update citrea-e2e rev

* Use debug build

* Update citrea-e2e

* Prover generate input rpc (#1280)

* WIP Implement prover generate rpcg

* It compiles but stf is modified

* Context

* Fix Context: Send

* Merge fix

* Move function from common to prover

* Remove code duplicate and unnecessary log

* Add optional parameter to break commitments into groups

* Return input as string

---------

Co-authored-by: Roman Proskuryakoff <[email protected]>

* Move node configs to citrea-common (#1286)

* move node configs to a seperate crate

* fix udeps

* remove native feature

* move SequencerConfig

* move config to citrea-common

* fix use statements

* Update e2e test framework and fix tests (#1305)

* Update e2e test framework and fix tests

* Fix bug

* Update ci binary env key

* Test if new fix works

* Update bitcoincore-rpc version

* Dprint

* Try against fix prover config rev

* Target main HEAD rev

---------

Co-authored-by: jfldde <[email protected]>

* build and publish a new image for every commit to the nightly branch (#1309)

* Get fee recommendation from mempool space (#1302)

* Get fee recommendation from mempool space

* Fix bug

* Construct mempool space endpoint by network

---------

Co-authored-by: Esad Yusuf Atik <[email protected]>

* new path fix for nightly (#1310)

* Enable pending block tag in simulation endpoints (#1303)

* treat pending tag same as latest

* fix lint

* return new sealed block for pending

* handle pending tag externally

* revert enabling pending in some endpoints

* get blockenv instead of sealed block

* address review comments

* implement tests for eth_call, eth_estimateGas, eth_createAccessList pending blocks

* rename tests

---------

Co-authored-by: eyusufatik <[email protected]>

* Implement state and block overrides (#1270)

* Implement state and block overrides

* Update comment

* apply_block_overrides func

* apply_state_overrides func

* Use a single func for replacing account storage

* Clippy

* Address feedback

Use Reth's BlockOverrides with saturating_to to convert back to u64

* Test for block overrides

* Test for state overrides

* Comment tests

* Create a fresh working set

* Remove box

* remove alloy-serde

---------

Co-authored-by: eyusufatik <[email protected]>

* Use spawn_blocking for da queue (#1311)

* Fetch smart fee only if none (#1312)

* update run doc and changelog (#1315)

---------

Co-authored-by: Rakan Al-Huneiti <[email protected]>
Co-authored-by: Ahmet Yazıcı <[email protected]>
Co-authored-by: Erce Can Bektüre <[email protected]>
Co-authored-by: jfldde <[email protected]>
Co-authored-by: Erce Can Bektüre <[email protected]>
Co-authored-by: Roman Proskuryakoff <[email protected]>
Co-authored-by: Ege Okan Ünaldı <[email protected]>
Co-authored-by: Çetin <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Switch to mempool.space fee estimation
4 participants