WARN STARTUP "Shadowgraph: Missing non-expired self parent for EventDescriptorWrapper"

[alex-kuzmin-hg]

Description

example log: https://perf.analytics.eng.hashgraph.io/ephemeral/BufferUnder_Overflow_0.58.3_Reconnect/podlog_solo-alex-kuzmin-n3/network-node9_logs/swirlds.log

Statistics:
it was thrown 1732 times during 8 hours , Reconnect test on 10 nodes

Very frequent new warning
WARN STARTUP <platformForkJoinThread-8> Shadowgraph: Missing non-expired self parent for EventDescriptorWrapper

details:

2025-01-14 22:59:51.701 7066     WARN  STARTUP          <platformForkJoinThread-8> Shadowgraph: Missing non-expired self parent for EventDescriptorWrapper[eventDescriptor=EventDescriptor[hash=8ccaa086a8f99bed848740c836e6f6b264f8f4c89c5c7fbd8f1d10eecea03dbd5d0212cbab43fd52ff3de7e04ba218e2, creatorNodeId=9, birthRound=1, generation=33597], hash=8ccaa086a8f99bed848740c836e6f6b264f8f4c89c5c7fbd8f1d10eecea03dbd5d0212cbab43fd52ff3de7e04ba218e2, creator=9]
    sp: EventDescriptorWrapper[eventDescriptor=EventDescriptor[hash=706711ada1e725e8749940006319fc05a5cf69bfb6fea6c057e0fe8f58ad6f5a9b3dbfa00236e2d93791bf48eb7d9747, creatorNodeId=9, birthRound=1, generation=33474], hash=706711ada1e725e8749940006319fc05a5cf69bfb6fea6c057e0fe8f58ad6f5a9b3dbfa00236e2d93791bf48eb7d9747, creator=9]
    op0: EventDescriptorWrapper[eventDescriptor=EventDescriptor[hash=90b23d724ecedadf8a88869ac8bce2caf4de75dc617db033395f26f3465b46c58586ca706f805dd362d16246762b3f24, creatorNodeId=6, birthRound=1, generation=33596], hash=90b23d724ecedadf8a88869ac8bce2caf4de75dc617db033395f26f3465b46c58586ca706f805dd362d16246762b3f24, creator=6]

Steps to reproduce

Run 100M accounts SmartContract load test with 10mins Reconnect

Additional context

No response

Hedera network

other, previewnet

Version

v0.58.3

Operating system

Linux

[alex-kuzmin-hg]

Duplicate of #15333

[edward-swirldslabs]

I am not expecting to see this warning that frequently. It does appear like something might be wrong. @poulok

[poulok]

@lpetrovic05 , i don't think this is a problem, even at this rate, but want to confirm with you before closing this and the duplicate ticket listed

[lpetrovic05]

@poulok this happens when we have stale events, the metrics should be checked to confirm

[edward-swirldslabs]

Is there a scenario where the warning that is displayed here will be useful in debugging? Should its label be changed to debug? If we're going to tolerate this frequency of WARN, then I am concerned that we are desensitizing ourselves to what a WARN should be.

[lpetrovic05]

Is there a scenario where the warning that is displayed here will be useful in debugging? Should its label be changed to debug? If we're going to tolerate this frequency of WARN, then I am concerned that we are desensitizing ourselves to what a WARN should be.

I think you are right