Skip to content

Commit

Permalink
fix: Skip buffered rows which are not joined with streamed side when …
Browse files Browse the repository at this point in the history
…checking join filter results (#12159)
  • Loading branch information
viirya authored Aug 26, 2024
1 parent 0f96af5 commit dff590b
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions datafusion/physical-plan/src/joins/sort_merge_join.rs
Original file line number Diff line number Diff line change
Expand Up @@ -1474,6 +1474,12 @@ impl SMJStream {
[chunk.buffered_batch_idx.unwrap()];

for i in 0..pre_mask.len() {
// If the buffered row is not joined with streamed side,
// skip it.
if buffered_indices.is_null(i) {
continue;
}

let buffered_index = buffered_indices.value(i);

buffered_batch.join_filter_failed_map.insert(
Expand Down

0 comments on commit dff590b

Please sign in to comment.