BlockchainBasedList inconsistency

[mbg033]

1. /presale call completed successfully:

2019-08-19 19:22:24.227	    7f9f529b7c00	INFO 	supernode.connection	src/lib/graft/connection.cpp:534	[**.**.***.**:46640] New HTTP client. uri:/dapi/v2.0/presale method:POST remote: **.**.***.**:12470
2019-08-19 19:22:24.227	    7f9f529b7c00	DEBUG	supernode.connection	src/lib/graft/connection.cpp:547	[**.**.***.**:46640] Matching Route found; body = {
  "PaymentID": "4cc70627b4ab435a577c0533cae2fac690048ed1deef5c71e904160419801"
}
2019-08-19 19:22:24.228	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:356	building auth sample for height 0 (blockchain_based_list_height=386557) and PaymentID '4cc70627b4ab435a577c0533cae2fac690048ed1deef5c71e904160419801'
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:371	use blockchain based list for height 386557
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:375	...tier #1
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:378	.....[0]=d4ac0055d450c342be518c455adc5a28a8825a4d259da480d7408a5089d4bbd7
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:378	.....[1]=cdba49cbdece633266681b3c6f80f1085e7b3d3e0cca395d3986d10ab3ea0d6a
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:378	.....[2]=ce7cf758df6f2eb7f74d28730078be733cb953bda37a5f6e54ab09140f40e712
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:378	.....[3]=002fc53f231568a2ecd6387db83e1a0211d5060a91f0534fdf5474a7e9b556ae
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:378	.....[4]=217c474a2394584a74051a7dd579c496dd3bc0768e8c56c69659ac93c8f78023
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:378	.....[5]=25b316d25e6c2dd8dd60fd983de9fbd5a9bb1fcf96d65bbb1c295708bafa00cb
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:378	.....[6]=54749bad9925d34e414062a4e3cf3991e1a1ee5c778fc6c44a53c11f55cafe44
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:378	.....[7]=914c13339fdfacdbbebe4c223d1900415432aab24f1f995823286104c7ac9eaa
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:378	.....[8]=ba3990991be1db9f05f47179e16ddad7f0959f952be8aaea0ee4d19e8d82ce7f
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:378	.....[9]=cd37fa657f7125f7fe9c14c0a206df16b01b24117b43bb8aa3cf85c4a1034132
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:375	...tier #2
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:378	.....[0]=a83772afaf1c1b43ea36963aff4beb5133f75cccb09ad767282f527c7af75d2f
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:375	...tier #3
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:375	...tier #4
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:263	.....select random value 335661321807996398 items count is 8 with clamp to 10 items; result is 8
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:263	.....select random value 435834278973200433 items count is 8 with clamp to 9 items; result is 3
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:270	.....supernode cdba49cbdece633266681b3c6f80f1085e7b3d3e0cca395d3986d10ab3ea0d6a has been selected
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:263	.....select random value 4858689443023288439 items count is 7 with clamp to 8 items; result is 7
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:263	.....select random value 15123005929329145497 items count is 7 with clamp to 7 items; result is 6
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:270	.....supernode 002fc53f231568a2ecd6387db83e1a0211d5060a91f0534fdf5474a7e9b556ae has been selected
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:263	.....select random value 15605097627349114795 items count is 6 with clamp to 6 items; result is 1
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:270	.....supernode 217c474a2394584a74051a7dd579c496dd3bc0768e8c56c69659ac93c8f78023 has been selected
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:263	.....select random value 6106947963768567728 items count is 5 with clamp to 5 items; result is 3
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:270	.....supernode 25b316d25e6c2dd8dd60fd983de9fbd5a9bb1fcf96d65bbb1c295708bafa00cb has been selected
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:263	.....select random value 12641370161423772872 items count is 4 with clamp to 4 items; result is 0
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:270	.....supernode 54749bad9925d34e414062a4e3cf3991e1a1ee5c778fc6c44a53c11f55cafe44 has been selected
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:263	.....select random value 4721115108788260773 items count is 3 with clamp to 3 items; result is 0
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:270	.....supernode 914c13339fdfacdbbebe4c223d1900415432aab24f1f995823286104c7ac9eaa has been selected
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:263	.....select random value 1884253413556408240 items count is 2 with clamp to 2 items; result is 0
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:270	.....supernode ba3990991be1db9f05f47179e16ddad7f0959f952be8aaea0ee4d19e8d82ce7f has been selected
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:263	.....select random value 14362581243864878642 items count is 1 with clamp to 1 items; result is 0
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:270	.....supernode cd37fa657f7125f7fe9c14c0a206df16b01b24117b43bb8aa3cf85c4a1034132 has been selected
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:395	...8 supernodes has been selected for tier 1 from blockchain based list with 10 supernodes
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:263	.....select random value 14648882601427339254 items count is 1 with clamp to 1 items; result is 0
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:270	.....supernode a83772afaf1c1b43ea36963aff4beb5133f75cccb09ad767282f527c7af75d2f has been selected
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:395	...1 supernodes has been selected for tier 2 from blockchain based list with 1 supernodes
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:395	...0 supernodes has been selected for tier 3 from blockchain based list with 0 supernodes
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:395	...0 supernodes has been selected for tier 4 from blockchain based list with 0 supernodes
2019-08-19 19:22:24.229	    7f9f51999700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:447	...8 supernodes has been selected
2019-08-19 19:22:24.273	    7f9f529b7c00	TRACE	supernode.task	src/lib/graft/task.cpp:559	[**.**.***.**:46640] worker_action completed with result Ok
2019-08-19 19:22:24.273	    7f9f529b7c00	DEBUG	supernode.connection	src/lib/graft/connection.cpp:698	[**.**.***.**:46640] Reply to client: {"BlockNumber":386557,"BlockHash":"396bed82589e9db3a684e0c21281197797b55e1c757858fded8696274616e120","AuthSample":["cdba49cbdece633266681b3c6f80f1085e7b3d3e0cca395d3986d10ab3ea0d6a","002fc53f231568a2ecd6387db83e1a0211d5060a91f0534fdf5474a7e9b556ae","217c474a2394584a74051a7dd579c496dd3bc0768e8c56c69659ac93c8f78023","25b316d25e6c2dd8dd60fd983de9fbd5a9bb1fcf96d65bbb1c295708bafa00cb","54749bad9925d34e414062a4e3cf3991e1a1ee5c778fc6c44a53c11f55cafe44","914c13339fdfacdbbebe4c223d1900415432aab24f1f995823286104c7ac9eaa","ba3990991be1db9f05f47179e16ddad7f0959f952be8aaea0ee4d19e8d82ce7f","a83772afaf1c1b43ea36963aff4beb5133f75cccb09ad767282f527c7af75d2f"],"PosProxy":{"Id":"cd37fa657f7125f7fe9c14c0a206df16b01b24117b43bb8aa3cf85c4a1034132","WalletAddress":"FASd82uEiEwGEcAyurvwZL6DT6DN1xnWT9EpYdS595puh5Tdzt3ehxnR6shvae7m7L8Tf8cGHrZNEQdJukxmoPB212MMCf9"}}
2019-08-19 19:22:24.273	    7f9f529b7c00	DEBUG	supernode.connection	src/lib/graft/connection.cpp:710	[**.**.***.**:46640] Client request finished with result Ok

2. few seconds later, /debug/auth_sample2/ unable to build auth sample for the same height (no restarts between these calls):

2019-08-19 19:22:45.671	    7f9f529b7c00	INFO 	supernode.connection	src/lib/graft/connection.cpp:534	[**.**.***.**:46878] New HTTP client. uri:/debug/auth_sample2/4cc70627b4ab435a577c0533cae2fac690048ed1deef5c71e904160419801/386557 method:GET remote: **.**.**.**:7863
2019-08-19 19:22:45.671	    7f9f529b7c00	DEBUG	supernode.connection	src/lib/graft/connection.cpp:547	[**.**.***.**:46878] Matching Route found; body = 
2019-08-19 19:22:45.671	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:356	building auth sample for height 386557 (blockchain_based_list_height=386557) and PaymentID '4cc70627b4ab435a577c0533cae2fac690048ed1deef5c71e904160419801'
2019-08-19 19:22:45.671	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:371	use blockchain based list for height 386557
2019-08-19 19:22:45.671	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:375	...tier #1
2019-08-19 19:22:45.671	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:378	.....[0]=d4ac0055d450c342be518c455adc5a28a8825a4d259da480d7408a5089d4bbd7
2019-08-19 19:22:45.672	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:375	...tier #2
2019-08-19 19:22:45.672	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:378	.....[0]=a83772afaf1c1b43ea36963aff4beb5133f75cccb09ad767282f527c7af75d2f
2019-08-19 19:22:45.672	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:375	...tier #3
2019-08-19 19:22:45.672	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:375	...tier #4
2019-08-19 19:22:45.672	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:263	.....select random value 335661321807996398 items count is 1 with clamp to 1 items; result is 0
2019-08-19 19:22:45.672	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:270	.....supernode d4ac0055d450c342be518c455adc5a28a8825a4d259da480d7408a5089d4bbd7 has been selected
2019-08-19 19:22:45.672	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:395	...1 supernodes has been selected for tier 1 from blockchain based list with 1 supernodes
2019-08-19 19:22:45.672	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:263	.....select random value 435834278973200433 items count is 1 with clamp to 1 items; result is 0
2019-08-19 19:22:45.672	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:270	.....supernode a83772afaf1c1b43ea36963aff4beb5133f75cccb09ad767282f527c7af75d2f has been selected
2019-08-19 19:22:45.672	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:395	...1 supernodes has been selected for tier 2 from blockchain based list with 1 supernodes
2019-08-19 19:22:45.672	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:395	...0 supernodes has been selected for tier 3 from blockchain based list with 0 supernodes
2019-08-19 19:22:45.672	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:395	...0 supernodes has been selected for tier 4 from blockchain based list with 0 supernodes
2019-08-19 19:22:45.672	    7f9f50196700	DEBUG	supernode.fullsupernodelist	src/rta/fullsupernodelist.cpp:447	...2 supernodes has been selected
2019-08-19 19:22:45.672	    7f9f529b7c00	TRACE	supernode.task	src/lib/graft/task.cpp:559	[**.**.***.**:46878] worker_action completed with result Error
2019-08-19 19:22:45.672	    7f9f529b7c00	DEBUG	supernode.connection	src/lib/graft/connection.cpp:698	[**.**.***.**:46878] Reply to client: {"code":-32603,"message":"failed to build auth sample"}
2019-08-19 19:22:45.672	    7f9f529b7c00	DEBUG	supernode.connection	src/lib/graft/connection.cpp:710	[**.**.***.**:46878] Client request finished with result Error