Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(expr): support any children in rw_vnode #18405

Merged
merged 3 commits into from
Oct 8, 2024
Merged

Conversation

BugenZhao
Copy link
Member

I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.

What's changed and what's your intention?

Previously, if the children of rw_vnode is not InputRef, it will panic. This is okay as most of the time, it's only used internally for 2-phase aggregation. However, since it's still user-facing for debugging purposes, we should make it more user-friendly.

Checklist

  • I have written necessary rustdoc comments
  • I have added necessary unit tests and integration tests
  • All checks passed in ./risedev check (or alias, ./risedev c)

Documentation

  • My PR needs documentation updates. (Please use the Release note section below to summarize the impact on users)

Release note

If this PR includes changes that directly affect users or other significant modifications relevant to the community, kindly draft a release note to provide a concise summary of these changes. Please prioritize highlighting the impact these changes will have on users.

Copy link
Member Author

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @BugenZhao and the rest of your teammates on Graphite Graphite

for child in &self.children {
arrays.push(child.eval(input).await?);
}
let input = DataChunk::new(arrays, input.visibility().clone());
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A little overhead of allocation.

@BugenZhao BugenZhao requested review from stdrc and st1page September 4, 2024 07:48
@stdrc
Copy link
Member

stdrc commented Sep 5, 2024

Do we really need to "debug" with this?


Ok(Box::new(VnodeExpression { dist_key_indices }))
Ok(Box::new(VnodeExpression {
all_indices: (0..children.len()).collect(),
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am confused by this field, although it's renamed from dist_key_indices. Can you please exemplify and explain its usage?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's a parameter required by VirtualNode::compute_row to project the distribution key columns. But it's true that this can be done in the callsite by simply attaching .project. Will change the signature.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, it's also used by VirtualNode::compute_chunk.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

input.project(dist_key_indices) is changed to children.eval(input) so no dist_key_indices needed anymore.

all_indices is a new field introduced to reduce redundant vec allocation.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe it's better to rename children to dist_key_exprs or sth.

@BugenZhao BugenZhao force-pushed the bz/vnode-expr-any-input branch from 7889c32 to 68ff5ea Compare September 30, 2024 03:18
@BugenZhao BugenZhao added this pull request to the merge queue Oct 8, 2024
Merged via the queue into main with commit 419c853 Oct 8, 2024
30 of 31 checks passed
@BugenZhao BugenZhao deleted the bz/vnode-expr-any-input branch October 8, 2024 10:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants