Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: abstract a common merger to do merge sort. #14020

Merged
merged 14 commits into from
Dec 18, 2023

Conversation

RinChanNOWWW
Copy link
Contributor

@RinChanNOWWW RinChanNOWWW commented Dec 14, 2023

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

Add a HeapMerger to do multi-way merge sort by using a binary heap.

TransformSortMerge, TransformSortSpill use this merger to do merge sort now.

The integration for TransformMultiSortMerge will be done in next PR, as there are some problems to solve. I don't want it block this PR.

Tests

  • Unit Test
  • Logic Test
  • Benchmark Test
  • No Test - Explain why

This change is Reviewable

@github-actions github-actions bot added the pr-refactor this PR changes the code base without new features or bugfix label Dec 14, 2023
@RinChanNOWWW RinChanNOWWW force-pushed the refactor-sort branch 7 times, most recently from fafc58a to bc37c9e Compare December 15, 2023 07:11
@RinChanNOWWW RinChanNOWWW force-pushed the refactor-sort branch 2 times, most recently from 904182b to fce46a1 Compare December 15, 2023 08:23
@RinChanNOWWW RinChanNOWWW added the ci-benchmark Benchmark: run all test label Dec 16, 2023
Copy link
Contributor

Docker Image for PR

  • tag: pr-14020-26ca3eb

note: this image tag is only available for internal use,
please check the internal doc for more details.

@RinChanNOWWW RinChanNOWWW force-pushed the refactor-sort branch 2 times, most recently from 186be1a to d155cf7 Compare December 16, 2023 05:10
@RinChanNOWWW RinChanNOWWW marked this pull request as ready for review December 17, 2023 01:42
@BohuTANG BohuTANG merged commit 45ca985 into databendlabs:main Dec 18, 2023
68 checks passed
@RinChanNOWWW RinChanNOWWW deleted the refactor-sort branch December 18, 2023 02:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci-benchmark Benchmark: run all test pr-refactor this PR changes the code base without new features or bugfix
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants