Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: Simplify code in CometExecIterator and avoid some small overhead #522

Merged
merged 1 commit into from
Jun 5, 2024

Conversation

andygrove
Copy link
Member

Which issue does this PR close?

N/A

Rationale for this change

In the original code, getNextBatch called executeNative which would create a Batch object which is then discarded in getNextBatch. This seems like unnecessary overhead even though it is small.

What changes are included in this PR?

  • Remove the interim Batch structure. Combine the two methods.
  • Add some comments

How are these changes tested?

Existing tests.

@andygrove andygrove requested review from sunchao and viirya June 5, 2024 19:16
Copy link
Member

@viirya viirya left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It was left from previous code before we revamped CometExecIterator, I think. Good to remove it.

@andygrove andygrove merged commit 7ab37eb into apache:main Jun 5, 2024
44 checks passed
@andygrove andygrove deleted the simplify-native-iterator branch June 5, 2024 21:31
himadripal pushed a commit to himadripal/datafusion-comet that referenced this pull request Sep 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants