deal stuck at Adding to Sector

[lbj2004032]

Checklist

• This is not a question or a support request. If you have any boost related questions, please ask in the discussion forum.
• This is not a new feature request. If it is, please file a feature request instead.
• This is not an enhancement request. If it is, please file a improvement suggestion instead.
• I have searched on the issue tracker and the discussion forum, and there is no existing related issue or discussion.
• I am running the Latest release, or the most recent RC(release canadiate) for the upcoming release or the dev branch(master), or have an issue updating to any of these.
• I did not make any code changes to boost.

Boost component

• boost daemon - storage providers
• boost client
• boost UI
• boost data-transfer
• boost index-provider
• Other

Boost Version

boostd version 1.7.2+git.4214dd7

Describe the Bug

deal stuck at Adding to Sector

Logging Information

miner.log

2023-05-09T11:04:29.791+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35800273 (publish msg: bafy2bzacecbckycltocyy56qyqil3ne47xhz5gi3skcxqrjv4mprki35gvqxw)
2023-05-09T11:04:29.791+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35803101 (publish msg: bafy2bzacebdkfvqw6m4ceakfhdzeh3u4nye35tk43m6jkvcwfbsogx2sefi7o)
2023-05-09T11:04:29.792+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35801198 (publish msg: bafy2bzaceamzfnnvnunwuc6uxtlihylwtwlt6sjpe2odofqxxx27wjtgeahdc)
2023-05-09T11:04:29.793+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35800804 (publish msg: bafy2bzaceaiaxz45ioc42bo6tuaudat5xrdxfyazz5hjzdbqg73a7m6plyaey)
2023-05-09T11:04:29.793+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35801205 (publish msg: bafy2bzaceamzfnnvnunwuc6uxtlihylwtwlt6sjpe2odofqxxx27wjtgeahdc)
2023-05-09T11:04:29.793+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35800272 (publish msg: bafy2bzacecbckycltocyy56qyqil3ne47xhz5gi3skcxqrjv4mprki35gvqxw)
2023-05-09T11:04:29.794+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35673252 (publish msg: bafy2bzacecmdp5ycboczeagiky55p3bo4vcjqhglrjwtc2ivlagwfjuwuyvde)
2023-05-09T11:04:29.795+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35800268 (publish msg: bafy2bzacecbckycltocyy56qyqil3ne47xhz5gi3skcxqrjv4mprki35gvqxw)
2023-05-09T11:04:29.796+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35801863 (publish msg: bafy2bzacedf7ib4hhoacxvs5ef7ddaajra5au7nzb3wrnq3rcnqh5s2pfrni4)
2023-05-09T11:04:29.796+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35721493 (publish msg: bafy2bzacea6z5t262yookvw2l5olzwrmfxf3v2hafkr74farrminbax5qpcku)
2023-05-09T11:04:29.797+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35801199 (publish msg: bafy2bzaceamzfnnvnunwuc6uxtlihylwtwlt6sjpe2odofqxxx27wjtgeahdc)
2023-05-09T11:04:29.797+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35800805 (publish msg: bafy2bzaceaiaxz45ioc42bo6tuaudat5xrdxfyazz5hjzdbqg73a7m6plyaey)
2023-05-09T11:04:29.797+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35802627 (publish msg: bafy2bzaceanbjy5dqendnkwihbeloexckyoryhmnw5tr25gm7q3xwggfazxps)
2023-05-09T11:04:29.798+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35800270 (publish msg: bafy2bzacecbckycltocyy56qyqil3ne47xhz5gi3skcxqrjv4mprki35gvqxw)
2023-05-09T11:04:29.798+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35801864 (publish msg: bafy2bzacedf7ib4hhoacxvs5ef7ddaajra5au7nzb3wrnq3rcnqh5s2pfrni4)
2023-05-09T11:04:29.799+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35800808 (publish msg: bafy2bzaceaiaxz45ioc42bo6tuaudat5xrdxfyazz5hjzdbqg73a7m6plyaey)
2023-05-09T11:04:29.800+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35800809 (publish msg: bafy2bzaceaiaxz45ioc42bo6tuaudat5xrdxfyazz5hjzdbqg73a7m6plyaey)
2023-05-09T11:04:29.800+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35803099 (publish msg: bafy2bzacebdkfvqw6m4ceakfhdzeh3u4nye35tk43m6jkvcwfbsogx2sefi7o)
2023-05-09T11:04:29.800+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35667105 (publish msg: bafy2bzacebnuvyjecahrgthqn3sdmcu7niskr4ielqo5maogjrqgz2qamqo54)
2023-05-09T11:04:29.802+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35721489 (publish msg: bafy2bzacea6z5t262yookvw2l5olzwrmfxf3v2hafkr74farrminbax5qpcku)
2023-05-09T11:04:29.803+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35800803 (publish msg: bafy2bzaceaiaxz45ioc42bo6tuaudat5xrdxfyazz5hjzdbqg73a7m6plyaey)
2023-05-09T11:04:29.803+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35801203 (publish msg: bafy2bzaceamzfnnvnunwuc6uxtlihylwtwlt6sjpe2odofqxxx27wjtgeahdc)
2023-05-09T11:04:29.804+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35801200 (publish msg: bafy2bzaceamzfnnvnunwuc6uxtlihylwtwlt6sjpe2odofqxxx27wjtgeahdc)
2023-05-09T11:04:29.804+0800    INFO    sectors pipeline/input.go:308   Adding piece for deal 35799786 (publish msg: bafy2bzacea6j6wronaxhqbyi2aoicf6btpe5s3scdvl42hbw5wqaiz5hqpod2)


bootsd.log
2023-05-09T11:04:29.787+0800    INFO    boost-storage-deal      logs/log.go:40  add piece called        {"id": "590d3dbd-9494-4df6-ba87-3bff3fcd6752"}
2023-05-09T11:04:29.788+0800    INFO    boost-storage-deal      logs/log.go:40  add piece called        {"id": "7379668b-9609-4c45-a76b-d68b3d8c4a26"}
2023-05-09T11:04:29.789+0800    INFO    boost-storage-deal      logs/log.go:40  add piece called        {"id": "8a3cd29e-8e0a-4a88-84f7-7322ff2c4440"}
2023-05-09T11:04:29.789+0800    INFO    boost-storage-deal      logs/log.go:40  add piece called        {"id": "75c5c3b6-ce17-436c-9271-468adc890b24"}
2023-05-09T11:04:29.791+0800    INFO    boost-storage-deal      logs/log.go:40  add piece called        {"id": "593ea365-79d0-44f9-b174-1f8e9599e3b2"}
2023-05-09T11:04:29.792+0800    INFO    boost-storage-deal      logs/log.go:40  add piece called        {"id": "e818a7ee-5ce0-4044-ad6a-14ec59121e7d"}
2023-05-09T11:04:29.792+0800    INFO    boost-storage-deal      logs/log.go:40  add piece called        {"id": "ab7bf4f5-656e-40cf-ad82-8cc9ff1b5beb"}
2023-05-09T11:04:29.794+0800    INFO    boost-storage-deal      logs/log.go:40  deal has already been published and confirmed-publish   {"id": "35cbe71e-87ca-4e08-801f-5f9d3a4aada8"}
2023-05-09T11:04:29.795+0800    INFO    boost-storage-deal      logs/log.go:40  funds successfully untagged for deal after publish      {"id": "35cbe71e-87ca-4e08-801f-5f9d3a4aada8"}
2023-05-09T11:04:29.796+0800    INFO    boost-storage-deal      logs/log.go:40  add piece called        {"id": "35cbe71e-87ca-4e08-801f-5f9d3a4aada8"}
2023-05-09T11:04:29.798+0800    INFO    boost-storage-deal      logs/log.go:40  add piece called        {"id": "394d2498-6957-40ee-ae61-bd556f7f8945"}
2023-05-09T11:04:29.798+0800    INFO    boost-storage-deal      logs/log.go:40  add piece called        {"id": "a4cb4fce-133a-4982-bbd8-c8066286e6de"}
2023-05-09T11:04:29.799+0800    INFO    boost-storage-deal      logs/log.go:40  add piece called        {"id": "512935a7-3ddf-4400-91d8-8ab4a9989614"}
2023-05-09T11:04:29.799+0800    INFO    boost-storage-deal      logs/log.go:40  add piece called        {"id": "1fb06b8b-8a1f-4c0d-988c-8d0f3e1be1d3"}
2023-05-09T11:04:31.925+0800    DEBUG   unsmgr  indexprovider/unsealedstatemanager.go:98        checking for sector state updates for 0 states
2023-05-09T11:04:34.752+0800    INFO    index-provider-wrapper  indexprovider/wrapper.go:211    announced endpoint to indexer with advertisement cid baguqeera6mynsuianl6yzmhccdffuv2yuvz5hpho4agpsnewiyvbgzpezxqq
2023-05-09T11:05:01.321+0800    ERROR   rpc     [email protected]/server.go:107 RPC Error: method 'Filecoin.ActorAddress' not found

Repo Steps

1. Run '...'
2. Do '...'
3. See error '...'
   ...

[LexLuthr]

@lbj2004032 Please note that Boost does not handle AP() task. You need to check your miner logs to figure out what is preventing the deals from being added to a sector. Mostly likely suspect will be that deal end epoch is higher than the sector expiry epoch.

[lbj2004032]

Get me the sector number for sectors in "SnapDealWaitDeal" state and their expire epoch

I changed config.toml set
PreferNewSectorsForDeals = true
AllowReplicaUpdate = true

so the sector status is Available now

SectorID: 137183
Status: Available
CIDcommD: baga6ea4seaqao7s73y24kcutaosvacpdjgfe5pw76ooefnyqw4ynr3d2y6x2mpq
CIDcommR: bagboea4b5abcbha5zlpz5tf5e5oslw42apkot4wfufcxwoxmbgfwrrklnsp7ks2l
Ticket: 2b90dcbe43b4c9713e5fb5763e6f2e9fed779033a4e55cc19bfee9cc25738b8b
TicketH: 2852147
Seed: a44c78ef11094b966cc59811b1986a82a88a0e535c10f38fc639227a6ace084d
SeedH: 2855684
Precommit: bafy2bzaceadvowwntxu67kuyntrvj4t56nswcpp2agbdjkzqfxbqm724gvj7w
Commit: bafy2bzaced4dz53besoqcppyqc7zse4set4zvw2we3z7iqg67hf7wrhao2g5q
Deals: [0]
Retries: 0
lotus@p1p2-172:/mnt/lotus1$ lotus-miner sectors status -c 137183
SectorID: 137183
Status: Available
CIDcommD: baga6ea4seaqao7s73y24kcutaosvacpdjgfe5pw76ooefnyqw4ynr3d2y6x2mpq
CIDcommR: bagboea4b5abcbha5zlpz5tf5e5oslw42apkot4wfufcxwoxmbgfwrrklnsp7ks2l
Ticket: 2b90dcbe43b4c9713e5fb5763e6f2e9fed779033a4e55cc19bfee9cc25738b8b
TicketH: 2852147
Seed: a44c78ef11094b966cc59811b1986a82a88a0e535c10f38fc639227a6ace084d
SeedH: 2855684
Precommit: bafy2bzaceadvowwntxu67kuyntrvj4t56nswcpp2agbdjkzqfxbqm724gvj7w
Commit: bafy2bzaced4dz53besoqcppyqc7zse4set4zvw2we3z7iqg67hf7wrhao2g5q
Deals: [0]
Retries: 0

Sector On Chain Info
SealProof: 8
Activation: 2855714
Expiration: 4404973
DealWeight: 0
VerifiedDealWeight: 0
InitialPledge: 0.212594995596033267 FIL

Expiration Info
OnTime: 4406988
Early: 0

---

SectorID: 137184
Status: Available
CIDcommD: baga6ea4seaqao7s73y24kcutaosvacpdjgfe5pw76ooefnyqw4ynr3d2y6x2mpq
CIDcommR: bagboea4b5abcbtwxsxscc52r26dux4ozknkxhhuxq5swrs7t2k3ewv4rqdep4ts7
Ticket: e9d5f9d5152f7dd19845ab2198ae1fea138743f3962795faeb21cf9ad81b949a
TicketH: 2852153
Seed: 3f4ee8e4838c125ee7145e59514559033bccec002bb67e1ec83f6fb6a9180be5
SeedH: 2855740
Precommit: bafy2bzaceaqtvgfcyf2hg3v33yyrwb3ymkzdt6r4coxhkhgallq6tl2vsoqro
Commit: bafy2bzacecxvpz6nezqxtdvqspm5ksb2bqgc6gqdv6ao2a7vvmggsi2qy4imw
Deals: [0]
Retries: 0

Sector On Chain Info
SealProof: 8
Activation: 2855775
Expiration: 4405028
DealWeight: 0
VerifiedDealWeight: 0
InitialPledge: 0.212573133984357054 FIL

Expiration Info
OnTime: 4406988
Early: 0

[LexLuthr]

Get me the same for 136927 and 136918

[lbj2004032]

Get me the same for 136927 and 136918

$ lotus-miner sectors status -c 136927
SectorID: 136927
Status: Proving
CIDcommD: baga6ea4seaqao7s73y24kcutaosvacpdjgfe5pw76ooefnyqw4ynr3d2y6x2mpq
CIDcommR: bagboea4b5abcbe7solngcjhkzs3wt7pl6sz5vpx3hlj2ukdivjgwuwakzzg5x5iu
Ticket: 964e72fec8b1c0c4d9052614395822fc6359866708b2ac214bfd6486d7df88f6
TicketH: 1937378
Seed: fd69339b1255aa8e4f84df7951a2279b5a75110fd24435c5b19e0f6cb14d113e
SeedH: 1938928
Precommit: bafy2bzaceahtn4cfhapwx6qgj6srb6d22ugjv4lg7tp7buefcmfdlzddqqd52
Commit: bafy2bzacecupz266mjqepczshwwgh5ekmzdb35mr7vqdvyqhzzcfom2e5w4wu
Deals: [0]
Retries: 0

Sector On Chain Info
SealProof: 8
Activation: 1939029
Expiration: 4235046
DealWeight: 0
VerifiedDealWeight: 0
InitialPledge: 0.168905110529025309 FIL

Expiration Info
OnTime: 4237068
Early: 0

---

$ lotus-miner sectors status -c 136918
SectorID: 136918
Status: Proving
CIDcommD: baga6ea4seaqao7s73y24kcutaosvacpdjgfe5pw76ooefnyqw4ynr3d2y6x2mpq
CIDcommR: bagboea4b5abcbstylkqt3qjvqv7jcquvynwiffxuczh55l5spiafnyn4vb6ng7ld
Ticket: 5f6ded45bc32a80a460491fd31e8e380d12890e2d1beebd361f7b361057229e9
TicketH: 1937278
Seed: f64fdd474919b6a5063b82223ac429e499b44bea734577f5659ed04c65c7447c
SeedH: 1938839
Precommit: bafy2bzacebuapob4jdfscvyd65bilmod7z26qpqd73nck6aikf7r6ut42mpdw
Commit: bafy2bzacec54bmevvq2mkuhah42nviy5hbbua3f67zpivgjbt33m7elhlkdv4
Deals: [0]
Retries: 0

Sector On Chain Info
SealProof: 8
Activation: 1938933
Expiration: 4235046
DealWeight: 0
VerifiedDealWeight: 0
InitialPledge: 0.168905132117681339 FIL

Expiration Info
OnTime: 4237068
Early: 0

[LexLuthr]

I am going to continue this conversation on slack. It would be faster there.

[lbj2004032]

I am going to continue this conversation on slack. It would be faster there.

I'll take a look back

I'm not very familiar with Slack

[lbj2004032]

[LexLuthr]

I would need miner logs to check what might be wrong.

[LexLuthr]

It clear that no sectors can accommodate the deals. Please compare deal expire epoch with sector expire epoch and extend the sectors if their expire epoch is before the deal expire epoch.

[lbj2004032]

epoch

I want to know how the epoch is calculated, for example what 518400 means

[LexLuthr]

https://spec.filecoin.io/#section-glossary.epoch