You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Summary
Currently pruning process is blocking the entire pipeline. By integrating the pruning process into the pipeline, the parallelism of pruning and query execution can be enhanced.
Hi, when refactoring the fuse pruner, let's keep in mind that Databend has multiple engines like Hive Table, Delta Table, and Iceberg Table. It would be better to refactor in a way that can be shared among them.
It would be better to refactor in a way that can be shared among them.
I am planing to split the different table engines' pruning process into processors. Some of them have probablity to be refactored as a sharing processor. Plan to first start with fuse engine. Thanks for the reminding, will keep in mind.
Summary
Currently pruning process is blocking the entire pipeline. By integrating the pruning process into the pipeline, the parallelism of pruning and query execution can be enhanced.
Related PR: #11552
The text was updated successfully, but these errors were encountered: