Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Excessive info logs generated by Nodeos causing rapid increase in syslog size #1240

Closed
sajjadbaeidi opened this issue Jun 6, 2023 · 1 comment · Fixed by #1271
Closed

Excessive info logs generated by Nodeos causing rapid increase in syslog size #1240

sajjadbaeidi opened this issue Jun 6, 2023 · 1 comment · Fixed by #1271
Assignees
@heifner
Labels
actionable bug Something isn't working 👍 lgtm OCI Work exclusive to OCI team
Milestone
Leap 4.0.2

Comments

@sajjadbaeidi
Copy link

We are using leap v4.0.1. The nodeos is generating a ton of info logs, which is significantly increasing the size of the syslog. the syslog size reaches around 5G in an hour.
The issue has been seen on the Telos network but seems not specific to Telos.
I have attached a sample of the logs here.

info  2023-06-06T21:04:03.423 net-5     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.424 net-7     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.424 net-8     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.424 net-6     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.424 net-9     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.424 net-2     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.424 net-5     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.424 net-7     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.425 net-8     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.425 net-6     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.425 net-9     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.425 net-2     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.425 net-5     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.426 net-7     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.426 net-8     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.426 net-6     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.426 net-9     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.426 net-2     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.427 net-5     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.427 net-7     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.427 net-8     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.427 net-6     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.427 net-9     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.427 net-2     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.428 net-5     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.428 net-7     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.428 net-8     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
info  2023-06-06T21:04:03.428 net-6     net_plugin.cpp:1852           recv_handshake       ] ["eosn-telos-snap43c:9876 - 99cb874" - 5 10.88.125.204:9876] handshake lib 282260315, head 282260650, head id 07929b37c8eb5180.. sync 4, head 282260671, lib 282260339
@heifner heifner added bug Something isn't working actionable and removed triage labels Jun 6, 2023
@BenjaminGormanPMP BenjaminGormanPMP added this to the Leap 4.0.2 milestone Jun 8, 2023
@bhazzard
Copy link

bhazzard commented Jun 8, 2023

Merge to 5.0 and backport to 4.0

heifner added a commit that referenced this issue Jun 9, 2023
@heifner
GH-1240 Prevent infinite loop in net_plugin by not sending back a han…
bb28937 
…dshake for a catch_up notice if nothing new to report.
@heifner heifner added the OCI Work exclusive to OCI team label Jun 9, 2023
@heifner heifner moved this from Todo to In Progress in Team Backlog Jun 9, 2023
@heifner heifner mentioned this issue Jun 9, 2023
Merged
heifner added a commit that referenced this issue Jun 10, 2023
@heifner
GH-1240 get_time is supposed to be nanoseconds
affbbd0
heifner added a commit that referenced this issue Jun 10, 2023
@heifner
GH-1240 Better handling of close when not syncing
8ffb1b4
@heifner heifner mentioned this issue Jun 12, 2023
Merged
heifner added a commit that referenced this issue Jun 12, 2023
@heifner
Merge pull request #1267 from AntelopeIO/GH-1240-net-loop-4.0
bccfa16 
[4.0] P2P excessive logging caused by message spamming
heifner added a commit that referenced this issue Jun 12, 2023
@heifner
Merge remote-tracking branch 'origin/release/4.0' into GH-1240-net-lo…
45429a3 
…op-main
@heifner heifner mentioned this issue Jun 12, 2023
Merged
heifner added a commit that referenced this issue Jun 12, 2023
@heifner
Merge pull request #1271 from AntelopeIO/GH-1240-net-loop-main
d86ba3a 
[4.0 -> main] P2P excessive logging caused by message spamming
@github-project-automation github-project-automation bot moved this from In Progress to Done in Team Backlog Jun 12, 2023
@matthewdarwin matthewdarwin mentioned this issue Jun 14, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@heifner heifner

Labels
actionable bug Something isn't working 👍 lgtm OCI Work exclusive to OCI team
Projects
Team Backlog
Archived in project
Milestone
Leap 4.0.2
Development

Successfully merging a pull request may close this issue.

[4.0 -> main] P2P excessive logging caused by message spamming AntelopeIO/leap
5 participants
@bhazzard @heifner @sajjadbaeidi @enf-ci-bot @BenjaminGormanPMP