Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

P2P: Sync not making progress after a timeout and reassign_fetch #583

Closed
heifner opened this issue Aug 19, 2024 · 0 comments · Fixed by #590 or #593
Closed

P2P: Sync not making progress after a timeout and reassign_fetch #583

heifner opened this issue Aug 19, 2024 · 0 comments · Fixed by #590 or #593
Assignees
@heifner
Labels
bug The product is not working as was intended. 👍 lgtm OCI Work exclusive to OCI team
Milestone
Spring v1.0.0-rc2

Comments

@heifner
Copy link
Member

heifner commented Aug 19, 2024 

Aug 19 02:33:56 kylin-snap143d nodeos[687926]: info  2024-08-19T02:33:56.035 net-4     net_plugin.cpp:2221           sync_reassign_fetch  ] ["eosn-kylin-seed171:9876:blk - bd81f0b" - 3 10.88.111.207:9876] reassign_fetch, our last req is 205000179, next expected is 204999590
Aug 19 02:33:56 kylin-snap143d nodeos[687926]: info  2024-08-19T02:33:56.035 net-4     net_plugin.cpp:1738           cancel_sync          ] ["eosn-kylin-seed171:9876:blk - bd81f0b" - 3 10.88.111.207:9876] sending empty request but not calling sync wait
Aug 19 02:33:56 kylin-snap143d nodeos[687926]: info  2024-08-19T02:33:56.035 net-4     net_plugin.cpp:1459           _close               ] ["eosn-kylin-seed171:9876:blk - bd81f0b" - 3 10.88.111.207:9876] closing
Aug 19 02:33:56 kylin-snap143d nodeos[687926]: info  2024-08-19T02:33:56.035 net-4     net_plugin.cpp:1693           operator()           ] ["eosn-kylin-seed171:9876:blk - bd81f0b" - 3 10.88.111.207:9876] async write socket changed before callback
Aug 19 02:33:56 kylin-snap143d nodeos[687926]: info  2024-08-19T02:33:56.036 net-0     net_plugin.cpp:2160           operator()           ] ["eosn-kylin-seed171:9876 - bd81f0b" - 7724 10.88.111.207:47690] requesting range 204999590 to 205000589, fhead 204999589, lib 204998322
Aug 19 02:33:56 kylin-snap143d nodeos[687926]: info  2024-08-19T02:33:56.036 net-0     net_plugin.cpp:2270           recv_handshake       ] ["eosn-kylin-seed171:9876 - bd81f0b" - 7724 10.88.111.207:47690] handshake lib 369020647, fhead 369020976, id 0ccc16a13aeeaafe.. sync 1, fhead 204999590, lib 204998334
Aug 19 02:33:56 kylin-snap143d nodeos[687926]: info  2024-08-19T02:33:56.036 net-6     net_plugin.cpp:2974           operator()           ] ["eosn-kylin-seed171:9876 - bd81f0b" - 7724 10.88.111.207:47690] Peer closed connection
Aug 19 02:33:56 kylin-snap143d nodeos[687926]: info  2024-08-19T02:33:56.036 net-6     net_plugin.cpp:3002           operator()           ] ["eosn-kylin-seed171:9876 - bd81f0b" - 7724 10.88.111.207:47690] Closing connection
Aug 19 02:33:56 kylin-snap143d nodeos[687926]: info  2024-08-19T02:33:56.036 net-6     net_plugin.cpp:1459           _close               ] ["eosn-kylin-seed171:9876 - bd81f0b" - 7724 10.88.111.207:47690] closing

Stays in a state of:

Aug 19 03:37:58 kylin-snap143d nodeos[687926]: info  2024-08-19T03:37:58.120 net-6     net_plugin.cpp:2270           recv_handshake       ] ["eosn-kylin-seed171:9876 - bd81f0b" - 7725 10.88.111.207:53760] handshake lib 369028327, fhead 369028660, id d8ae8983d14eda9e.. sync 1, fhead 204999590, lib 204999265
Aug 19 03:37:58 kylin-snap143d nodeos[687926]: info  2024-08-19T03:37:58.120 net-6     net_plugin.cpp:1599           operator()           ] ["eosn-kylin-seed171:9876 - bd81f0b" - 7725 10.88.111.207:53760] Sending handshake generation 770, lib 204999265, fhead 204999590, id 1e99efa8975c1cd6
Aug 19 03:37:58 kylin-snap143d nodeos[687926]: info  2024-08-19T03:37:58.120 net-3     net_plugin.cpp:2270           recv_handshake       ] ["eosn-kylin-seed171:9876:blk - bd81f0b" - 3 10.88.111.207:9876] handshake lib 369028327, fhead 369028660, id d8ae8983d14eda9e.. sync 1, fhead 204999590, lib 204999265
Aug 19 03:37:58 kylin-snap143d nodeos[687926]: info  2024-08-19T03:37:58.121 net-3     net_plugin.cpp:1599           operator()           ] ["eosn-kylin-seed171:9876:blk - bd81f0b" - 3 10.88.111.207:9876] Sending handshake generation 770, lib 204999265, fhead 204999590, id 1e99efa8975c1cd6

Enabling debug output, provides the following:

Aug 19 15:21:43 kylin-snap143d nodeos[687926]: debug 2024-08-19T15:21:43.321 net-0     net_plugin.cpp:1181           operator()           ] ["eosn-kylin-seed171:9876:blk - bd81f0b" - 3 10.88.111.207:9876] handle notice_message
Aug 19 15:21:43 kylin-snap143d nodeos[687926]: debug 2024-08-19T15:21:43.321 net-0     net_plugin.cpp:3577           handle_message       ] ["eosn-kylin-seed171:9876:blk - bd81f0b" - 3 10.88.111.207:9876] this is a last irreversible notice with 369113098 pending blocks: 369113098 f2cba3232075f755...
Aug 19 15:21:43 kylin-snap143d nodeos[687926]: debug 2024-08-19T15:21:43.321 net-0     net_plugin.cpp:3597           handle_message       ] ["eosn-kylin-seed171:9876:blk - bd81f0b" - 3 10.88.111.207:9876] this is a last irreversible notice with 369113098 blocks
Aug 19 15:21:43 kylin-snap143d nodeos[687926]: debug 2024-08-19T15:21:43.321 net-0     net_plugin.cpp:2393           sync_recv_notice     ] ["eosn-kylin-seed171:9876:blk - bd81f0b" - 3 10.88.111.207:9876] sync_manager got last irreversible block notice
Aug 19 15:21:43 kylin-snap143d nodeos[687926]: debug 2024-08-19T15:21:43.321 net-0     net_plugin.cpp:2183           is_sync_required     ] last req = 205000589, last recv = 204999591 known = 369112771 our fhead = 204999590
Aug 19 15:21:43 kylin-snap143d nodeos[687926]: debug 2024-08-19T15:21:43.321 net-0     net_plugin.cpp:2209           start_sync           ] ["eosn-kylin-seed171:9876:blk - bd81f0b" - 3 10.88.111.207:9876] already syncing, start sync ignored
@enf-ci-bot enf-ci-bot moved this to Todo in Team Backlog Aug 19, 2024
@heifner heifner added this to the Spring v1.0.0-rc2 milestone Aug 19, 2024
@heifner heifner self-assigned this Aug 19, 2024
@heifner heifner added the OCI Work exclusive to OCI team label Aug 19, 2024
@heifner heifner moved this from Todo to In Progress in Team Backlog Aug 19, 2024
@arhag arhag added bug The product is not working as was intended. 👍 lgtm and removed triage labels Aug 19, 2024
heifner added a commit that referenced this issue Aug 19, 2024
@heifner
GH-583 Track sync time to know when to allow a new start sync
dbed17c
@heifner heifner mentioned this issue Aug 19, 2024
Merged
heifner added a commit that referenced this issue Aug 19, 2024
@heifner
Merge pull request #590 from AntelopeIO/GH-583-sync-timeout
d54c4c1 
[1.0] P2P: Track sync time to know when to allow a new start sync
heifner added a commit that referenced this issue Aug 19, 2024
@heifner
Merge remote-tracking branch 'spring/release/1.0' into GH-583-sync-ti…
ad08986 
…meout-main
@heifner heifner mentioned this issue Aug 19, 2024
Merged
heifner added a commit that referenced this issue Aug 20, 2024
@heifner
Merge pull request #593 from AntelopeIO/GH-583-sync-timeout-main
23cf2fa 
[1.0 -> main] P2P: Track sync time to know when to allow a new start sync
@github-project-automation github-project-automation bot moved this from In Progress to Done in Team Backlog Aug 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@heifner heifner

Labels
bug The product is not working as was intended. 👍 lgtm OCI Work exclusive to OCI team
Projects
Team Backlog
Archived in project
Milestone
Spring v1.0.0-rc2
3 participants
@heifner @arhag @enf-ci-bot