Skip to content
This repository has been archived by the owner on Nov 6, 2020. It is now read-only.

Impossible to create snapshots with OverlayRecent pruning #7436

Closed
5chdn opened this issue Jan 3, 2018 · 5 comments
Closed

Impossible to create snapshots with OverlayRecent pruning #7436

5chdn opened this issue Jan 3, 2018 · 5 comments
Labels
F2-bug 🐞 The client fails to follow expected behavior. M4-core ⛓ Core client code / Rust. P2-asap 🌊 No need to stop dead in your tracks, however issue should be addressed as soon as possible. Q7-involved 💪 Can be fixed by a team of developers and probably takes some time.
Milestone

Comments

@5chdn
Copy link
Contributor

5chdn commented Jan 3, 2018

  • Which Parity version?: 1.8.5
  • Which operating system?: Linux
  • How installed?: binaries
  • Are you fully synchronized?: no
  • Did you try to restart the node?: no

As discussed on Riot.

a fresh parity installation warps directly to #4455000 (400k blocks behind)

2018-01-02 09:59 +00:00: 2018-01-02 09:59:05 UTC Snapshot: 1614697 accounts 0 blocks 396046888 bytes
2018-01-02 09:59 +00:00: 2018-01-02 09:59:06 UTC Imported #4841004 4986…90f2 (169 txs, 7.96 Mgas, 1128.18 ms, 34.60 KiB)
2018-01-02 09:59 +00:00: 2018-01-02 09:59:07 UTC Periodic snapshot failed: block state pruned.Run with a longer `--pruning-history` or with `--no-periodic-snapshot`

with pruning history of 1000 the bootnode only had time to put 1614697 accounts in before failing
according to etherscan there's 17.5 million accounts
at this rate we won't be able to produce snapshots with OverlayRecent pruning
we should look into enabling a different pruning algo that does not require keeping recent states in memory

@5chdn 5chdn added F2-bug 🐞 The client fails to follow expected behavior. M4-core ⛓ Core client code / Rust. P0-dropeverything 🌋 Everyone should address the issue now. labels Jan 3, 2018
@5chdn 5chdn added this to the 1.9 milestone Jan 3, 2018
@5chdn 5chdn changed the title Impossible to create snapshots in memory Impossible to create snapshots with OverlayRecent pruning Jan 3, 2018
@5chdn 5chdn mentioned this issue Jan 3, 2018
64 tasks
@5chdn
Copy link
Contributor Author

5chdn commented Jan 3, 2018

related to but not certainly the same issue #6372

@slavicd
Copy link

slavicd commented Jan 4, 2018

What does it mean for the regular user, though? Should one use geth for now or can this be mitigated somehow with parity? (Waiting 40+ hours for sync is not a solution, I believe)

@tomusdrw tomusdrw added F3-annoyance 💩 The client behaves within expectations, however this “expected behaviour” itself is at issue. P5-sometimesoon 🌲 Issue is worth doing soon. Q7-involved 💪 Can be fixed by a team of developers and probably takes some time. and removed P0-dropeverything 🌋 Everyone should address the issue now. F2-bug 🐞 The client fails to follow expected behavior. labels Jan 5, 2018
@tomusdrw tomusdrw modified the milestones: 1.9, 1.10 Jan 5, 2018
@5chdn 5chdn added F2-bug 🐞 The client fails to follow expected behavior. P2-asap 🌊 No need to stop dead in your tracks, however issue should be addressed as soon as possible. and removed F3-annoyance 💩 The client behaves within expectations, however this “expected behaviour” itself is at issue. P5-sometimesoon 🌲 Issue is worth doing soon. labels Jan 16, 2018
@5chdn 5chdn modified the milestones: 1.10, 1.11 Jan 23, 2018
@5chdn 5chdn mentioned this issue Jan 26, 2018
46 tasks
@5chdn 5chdn modified the milestones: 1.11, 1.12 Mar 1, 2018
@5chdn 5chdn modified the milestones: 1.12, 1.13 Apr 24, 2018
@folsen
Copy link
Contributor

folsen commented May 21, 2018

Closing in favor of all the ongoing work to improve snapshot creation/downloading/chunking.

@folsen folsen closed this as completed May 21, 2018
@5chdn
Copy link
Contributor Author

5chdn commented Jun 5, 2018

I'm unsure. This issue is far from being resolved and it gets more urgent every day. Please close if you are really sure this will be fixed soon by any other workaround.

@5chdn 5chdn reopened this Jun 5, 2018
@5chdn 5chdn modified the milestones: 2.1, 2.2 Jul 17, 2018
@5chdn 5chdn added this to the 2.2 milestone Sep 27, 2018
@5chdn 5chdn modified the milestones: 2.2, 2.3 Oct 29, 2018
@5chdn 5chdn modified the milestones: 2.3, 2.4 Jan 10, 2019
@5chdn 5chdn modified the milestones: 2.4, 2.5 Feb 21, 2019
@soc1c soc1c modified the milestones: 2.5, 2.6 Apr 2, 2019
@ordian ordian modified the milestones: 2.6, 2.7 Jul 12, 2019
@vorot93
Copy link

vorot93 commented Apr 15, 2020

Warp sync works now.

@vorot93 vorot93 closed this as completed Apr 15, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
F2-bug 🐞 The client fails to follow expected behavior. M4-core ⛓ Core client code / Rust. P2-asap 🌊 No need to stop dead in your tracks, however issue should be addressed as soon as possible. Q7-involved 💪 Can be fixed by a team of developers and probably takes some time.
Projects
None yet
Development

No branches or pull requests

7 participants