Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Traversal can end up keeping large amounts of path metadata #434

Open
willscott opened this issue May 24, 2022 · 0 comments
Open

Traversal can end up keeping large amounts of path metadata #434

willscott opened this issue May 24, 2022 · 0 comments
Assignees
@rvagg
Labels
need/analysis Needs further analysis before proceeding

Comments

@willscott
Copy link
Member

as seen in the legs synchronization filecoin-project/go-legs#126 we ended up seeing memory exhaustion at traversals of ~10,000 depth, and ended up segmenting the traversal process into smaller selectors limited to 2000 levels of recursion as a stop-gap.

That seems really small and like something has gone wrong at the traversal level to warrant that.
@rvagg rvagg moved this to 🗄️ Backlog in IPLD team's weekly tracker May 25, 2022
@rvagg rvagg added the need/analysis Needs further analysis before proceeding label May 25, 2022
@rvagg rvagg moved this from 🗄️ Backlog to 🥞 Todo in IPLD team's weekly tracker Aug 2, 2022
@rvagg rvagg self-assigned this Aug 2, 2022
@rvagg rvagg moved this from 🥞 Todo to 🗄️ Backlog in IPLD team's weekly tracker Nov 30, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@rvagg rvagg

Labels
need/analysis Needs further analysis before proceeding
Projects
IPLD team's weekly tracker
Status: 🗄️ Backlog
Milestone
No milestone
Development

No branches or pull requests
2 participants
@willscott @rvagg