Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use max_bytes_per_file in compaction planning #3139

Open
oceanusxiv opened this issue Nov 19, 2024 · 0 comments
Open

Use max_bytes_per_file in compaction planning #3139

oceanusxiv opened this issue Nov 19, 2024 · 0 comments

Comments

@oceanusxiv
Copy link

In #2728 I think it was stated that there might be plans to utilize this param for compaction planning. I'm not sure if this was tracked anywhere here, so I would file this here since this would be a pretty nice enhancement for me.

Compaction is almost entirely IO bound so for tables with large row sizes using this param during planning can result in substantially higher throughput (since as it stands it's unlikely to plan for more than one compaction task when row sizes are large but number of rows is relatively small).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant