Version 0.9.0 not syncing

[theoreticalbts]

This is for a new datadir initialized by connecting to another instance running on localhost. Restarting fixes it until it gets stuck at some later point. I think some in-memory structure might getting out of sync, but restarting re-initializes it.

I recall @nathanhourt had a similar issue.

I am thinking what is happening is that some in-memory structure is getting out of sync. A quick inspection of the code doesn't show anything obvious...

Here's a relevant section my p2p.log:

2015-04-26T09:00:00 th_a:invoke handle_message           push_block ] unable to link longest fork ["77a0a92f6535a6333ce1f3671349cd657ae6dcff",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain
_database.cpp:2068
2015-04-26T09:00:03 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:00:10 th_a:invoke handle_message           push_block ] unable to link longest fork ["9de54720073165d2993b9d517dc79da66397603d",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain
_database.cpp:2068
2015-04-26T09:00:13 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:00:13 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:00:13 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:00:13 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:00:13 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:00:13 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:00:16 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:00:20 th_a:invoke handle_message           push_block ] unable to link longest fork ["682ef75ee974e2ec3233b78cc7cf01c079fba190",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain
_database.cpp:2068
2015-04-26T09:00:29 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:00:30 th_a:invoke handle_message           push_block ] unable to link longest fork ["f1407b5a245f4318e3f946bdddd1c2f6add8ee39",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain
_database.cpp:2068
2015-04-26T09:00:40 th_a:invoke handle_message           push_block ] unable to link longest fork ["6bbb98c6feb9fc0608af9d9c4c17f510cdb78b87",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain
_database.cpp:2068
2015-04-26T09:00:42 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:00:50 th_a:invoke handle_message           push_block ] unable to link longest fork ["96e83eee613aa45d2e8ffc311af9df381ba29aab",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain
_database.cpp:2068
2015-04-26T09:00:55 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:01:00 th_a:invoke handle_message           push_block ] unable to link longest fork ["17e5ec6882ea322ba8721886edef19a246ae8af2",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain
_database.cpp:2068
2015-04-26T09:01:08 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:01:10 th_a:invoke handle_message           push_block ] unable to link longest fork ["0f1adb5d3f5a83789bb55c4914eb50f5e7b6fe63",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain
_database.cpp:2068
2015-04-26T09:01:13 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:01:13 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:01:20 th_a:invoke handle_message           push_block ] unable to link longest fork ["d1aea6f17200e066693386d0b69dcf3cb9c33df4",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain
_database.cpp:2068
2015-04-26T09:01:21 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:01:30 th_a:invoke handle_message           push_block ] unable to link longest fork ["6d8ca98b3321e9c2ce284a3adc5287aab4c4cac7",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain
_database.cpp:2068
2015-04-26T09:01:34 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:01:40 th_a:invoke handle_message           push_block ] unable to link longest fork ["b9400c0bdaa87acfa6274a46a234a8597a9fcbb8",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain
_database.cpp:2068
2015-04-26T09:01:47 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:01:50 th_a:invoke handle_message           push_block ] unable to link longest fork ["7560f27eee38c34d690ae71ef580a7210cfee18a",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain
_database.cpp:2068
2015-04-26T09:02:00 th_a:invoke handle_message           push_block ] unable to link longest fork ["d9d2d253143547f44d1ff9259c29e54be96b7c61",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain
_database.cpp:2068
2015-04-26T09:02:00 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:02:10 th_a:invoke handle_message           push_block ] unable to link longest fork ["4c805546fe76afcecfe93f0577b17df288eb36d6",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain
_database.cpp:2068
2015-04-26T09:02:13 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:02:13 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:02:13 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:02:13 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:02:13 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:02:20 th_a:invoke handle_message           push_block ] unable to link longest fork ["f3b7d6a09add0da2efbc54583899d5bd2e3f372a",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain
_database.cpp:2068
2015-04-26T09:02:26 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:02:30 th_a:invoke handle_message           push_block ] unable to link longest fork ["6c5d1ef4f4705ff1b3c8502211b322235d86ec66",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain
_database.cpp:2068
2015-04-26T09:02:39 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:02:40 th_a:invoke handle_message           push_block ] unable to link longest fork ["f4feaa36831d46a19608f02cc8f765779689d252",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:02:50 th_a:invoke handle_message           push_block ] unable to link longest fork ["3e8734eb1048efcdf6e0d6e005fb14442aa3730e",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:02:52 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:02:58 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:02:58 p2p:message read_loop process_ordinary_mes ] client rejected message sent by peer 127.0.0.1:1776, unknown balance record (31003)
                        node.cpp:3533
2015-04-26T09:03:00 th_a:invoke handle_message           push_block ] unable to link longest fork ["1820d6a87d4a1072e9d63d5292239f33f9c99fcc",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:03:05 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:03:10 th_a:invoke handle_message           push_block ] unable to link longest fork ["2edec2f824ec736278b8d27ce115765db52e15e2",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:03:18 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:03:20 th_a:invoke handle_message           push_block ] unable to link longest fork ["4998572a60c7ab8a41265e0880d23e270d2a0dca",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:03:30 th_a:invoke handle_message           push_block ] unable to link longest fork ["d84c2ca08d07825e04a5dd9dba67b9885cbda99a",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:03:31 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:03:40 th_a:invoke handle_message           push_block ] unable to link longest fork ["02c86b37af871b289b28019b3e9b264edde6ea01",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:03:44 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:03:50 th_a:invoke handle_message           push_block ] unable to link longest fork ["56dcd70ba51246843f5521e74cc3b337dc2b7da0",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:03:57 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:04:00 th_a:invoke handle_message           push_block ] unable to link longest fork ["0efc3e1bcdebb19ad872ae45f038596329350e0d",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:04:10 th_a:invoke handle_message           push_block ] unable to link longest fork ["320d3b3987e217d81339837e51eab1659a39d55c",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:04:10 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:04:20 th_a:invoke handle_message           push_block ] unable to link longest fork ["9d4135b65dab90e21fcf6bc4cef36e851519acd1",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:04:23 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:04:30 th_a:invoke handle_message           push_block ] unable to link longest fork ["e9b0c1d7bf2bcd0a60be6f404f724213913214d2",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:04:36 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:04:40 th_a:invoke handle_message           push_block ] unable to link longest fork ["8bc0b23b39487075e32793f6121a34888de76b42",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:04:44 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:04:49 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:04:50 th_a:invoke handle_message           push_block ] unable to link longest fork ["7094eb553ea04cbb257d07310c6decae3a49d053",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:05:00 th_a:invoke handle_message           push_block ] unable to link longest fork ["ae8f4f8b4d8e76e133a1571e8384471324a1138e",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:05:01 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:05:01 p2p:message read_loop process_ordinary_mes ] client rejected message sent by peer 127.0.0.1:1776, unknown market order (37002)
                        node.cpp:3533
2015-04-26T09:05:02 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:05:10 th_a:invoke handle_message           push_block ] unable to link longest fork ["4f2353db403a5d665df86fc51459954c55fad443",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:05:14 p2p:message read_loop process_ordinary_mes ] client rejected message sent by peer 127.0.0.1:1776, unknown balance record (31003)
                        node.cpp:3533
2015-04-26T09:05:15 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:05:20 th_a:invoke handle_message           push_block ] unable to link longest fork ["141e4d6a71ce601ee2b3aa7c85376760cabf96fb",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:05:28 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:05:30 th_a:invoke handle_message           push_block ] unable to link longest fork ["28354a14d0c2c51094b7c0f9206b9cc7b5ca7766",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:05:40 th_a:invoke handle_message           push_block ] unable to link longest fork ["0adb1c03c9f451c4973f4012b84a7e7dfba755c0",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:05:41 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:05:50 th_a:invoke handle_message           push_block ] unable to link longest fork ["2761781f78d48b4bf8ea60cda6ab4f397cd6e381",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:05:54 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:05:59 p2p:message read_loop process_ordinary_mes ] client rejected message sent by peer 127.0.0.1:1776, unknown balance record (31003)
                        node.cpp:3533
2015-04-26T09:06:00 p2p:message read_loop process_ordinary_mes ] client rejected message sent by peer 127.0.0.1:1776, unknown balance record (31003)
                        node.cpp:3533
2015-04-26T09:06:00 th_a:invoke handle_message           push_block ] unable to link longest fork ["0619661153f1d72ef1454cf35f63476b8222b882",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:06:07 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:06:10 th_a:invoke handle_message           push_block ] unable to link longest fork ["49a5b57e33e0c1b85aed95b09a212f8ce3965d0f",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:06:19 p2p:message read_loop process_ordinary_mes ] client rejected message sent by peer 127.0.0.1:1776, unknown market order (37002)
                       node.cpp:3533
2015-04-26T09:06:20 th_a:invoke handle_message           push_block ] unable to link longest fork ["474efcd56fe5ec4ae7b5656ce328644c13788e42",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:06:20 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:06:30 th_a:invoke handle_message           push_block ] unable to link longest fork ["5fbbc60ae7c7af7304337941fabcabcb0255cf19",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:06:33 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:06:40 th_a:invoke handle_message           push_block ] unable to link longest fork ["16074e3ccb1bf38f733aecfb3776d6ba86fd7870",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:06:46 p2p:message read_loop process_ordinary_mes ] client rejected message sent by peer 127.0.0.1:1776, unknown balance record (31003)
                        node.cpp:3533
2015-04-26T09:06:46 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:06:50 th_a:invoke handle_message           push_block ] unable to link longest fork ["b3dbd6bdb5a04b9931ab61f70fd85a767e1d6bdd",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:06:59 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:07:00 th_a:invoke handle_message           push_block ] unable to link longest fork ["9cd9b91a7ac592af2b709b8eda861ed736b51a54",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:07:10 th_a:invoke handle_message           push_block ] unable to link longest fork ["952bc6175ff5955e3a6f9c89669c693cbca6d607",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:07:12 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:07:18 p2p:message read_loop process_ordinary_mes ] client rejected message sent by peer 127.0.0.1:1776, unknown balance record (31003)
                        node.cpp:3533
2015-04-26T09:07:20 th_a:invoke handle_message           push_block ] unable to link longest fork ["cb5470df32b344be1e7c8d7c5e51d7ac33e652c1",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:07:25 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:07:30 th_a:invoke handle_message           push_block ] unable to link longest fork ["988ecc4a7cf54dcfcb0bc3f4c4703b3bb9c8f027",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:07:38 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:07:40 th_a:invoke handle_message           push_block ] unable to link longest fork ["7aaf22c5ed2daffce5f70f6c47736ac5f3e1ee95",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:07:51 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:07:52 th_a:invoke handle_message           push_block ] unable to link longest fork ["ba12fb29b5d8e67d95aae70561423a118fdad89b",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:08:00 th_a:invoke handle_message           push_block ] unable to link longest fork ["368072626dffe506ed493e2c08507e9f71d3482a",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068
2015-04-26T09:08:03 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:08:03 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:08:03 p2p:message read_loop on_item_not_availabl ] Peer doesn't have the requested item.                  node.cpp:2555
2015-04-26T09:08:04 th_a:rebroadcast_pending rebroadcast_pending_ ] rebroadcasting 13                   client.cpp:730
2015-04-26T09:08:10 th_a:invoke handle_message           push_block ] unable to link longest fork ["bf86f56c0e19f6133fe3de806ce82776944002ce",{"next_blocks":[],"is_linked":false,"is_included":false,"is_known":true}]                 chain_database.cpp:2068

[abitmore]

Looks like an earlier block before 77a0a92f6535a6333ce1f3671349cd657ae6dcff is missed, so the following blocks are marked as not_linked. Do you have earlier log?
It's also suspicious why "Peer doesn't have the requested item".

[vikramrajkumar]

Possibly related:

On 4/28/15, at 12:24 PM, svk wrote:
It syncs up using a chain server then once it's done it just falls out of sync

Sounds like same issue that was thought to have been addressed by: 65866b6