Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pull] main from datafuselabs:main #50

Open
wants to merge 496 commits into
base: main
Choose a base branch
from
Open

Conversation

pull[bot]
Copy link

@pull pull bot commented Sep 6, 2024

See Commits and Changes for more details.


Created by pull[bot]

Can you help keep this open source service alive? 💖 Please sponsor : )

Copy link

github-actions bot commented Sep 6, 2024

At least one test kind must be checked in the PR description.
@pull[bot] please update it 🙏.

Copy link

github-actions bot commented Sep 6, 2024

This pull request's title is not fulfill the requirements. @pull[bot] please update it 🙏.

Valid format:

fix(query): fix group by string bug
  ^         ^---------------------^
  |         |
  |         +-> Summary in present tense.
  |
  +-------> Type: rfc, feat, fix, refactor, ci, docs, chore

Valid types:

  • rfc: this PR proposes a new RFC
  • feat: this PR introduces a new feature to the codebase
  • fix: this PR patches a bug in codebase
  • refactor: this PR changes the code base without new features or bugfix
  • ci: this PR changes build/testing/ci steps
  • docs: this PR changes the documents or websites
  • chore: this PR only has small changes that no need to record

Copy link

github-actions bot commented Sep 6, 2024

At least one type of change must be checked in the PR description.
@pull[bot] please update it 🙏.

Copy link

github-actions bot commented Sep 6, 2024

Pull request description must contain CLA like the following:

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

## Summary

Summary about this PR

- Close #issue

@pull pull bot added the ⤵️ pull label Sep 6, 2024
everpcpc and others added 25 commits November 1, 2024 08:03
* feat: impl opendal::HttpFetch for HttpClient

* z

* z

* z

* z

* z

* z

* z

* z

* z

* z

* z

* z
* fix: keep column statistics of all NULL column

* add logic test

* fix typos reported by typos-cli
… debug mode (#16747)

* merge version

* merge version

* add unsafe comments

* add quick tests

* fix tests
* refactor: move `AbortChecker` into databend-common-catalog

* make `VACUUM TEMPORARY FILES` killable
…6718)

* save

* fix: fix skip empty block

* fix: ci test

* fix: performance degrade

* chore: change channel to a 1 sender - n receivers pattern

* chore: catch up main

* chore: remove useless path prefix

* chore: apply review suggestion to avoid using globalIORuntime

* chore: apply review suggestion to spawn in pipeline init stage

* try to find problem

* clippy
…meta service (#16759)

* chore: move UpsertKV to separate file

* test: ensure last-purged log-id cursor in exported from databend-meta service
Replace multiple error variants with a single `Damaged` variant:
- Remove: BytesError, SnapshotError, SledError
- Add: Damaged

These errors share the same error handling logic, making a single
variant more maintainable and semantically clearer.
* Feature: function about convert_timezone #16177

* Correction trait type

* Formatting the function

* Solving compiling issue

* Correcting file format

* adding tests

* Correction unti test

* Correction unit tests 2

* Correction unit tests 3

* Correction unit tests 4

* Correction unit tests 5

* Correction unit tests 6

* Correction unit tests 6

* Implementation of convert_timezone

* Correction registry and error handling

* Correction eval function

* Correction eval function 2

* Correction eval function 3

* Correction eval function 4

* Correction eval function 5

* Correction eval function 6

* Correction eval function 7

* Correction eval function 8

* Correction eval function 9

* Correction eval function 11

* Correction eval function 12

* Correction eval function 13 + add of the 3 arguments function version

* Code formatting

* Correction third parameter convert_timezone()

* Correction type

* Correction 1

* Correction 2

* Adding unit test

* Adding unit test 2

* Correciton unit test 4

* Correciton unit test 5

* Correciton unit test 6

* Correciton unit test 7

* Correction unit test 8

* Correction checked expr

* Correction convert_timezone

* Correction convert_timezone 2

* Correction convert_timezone 3

* Correction convert_timezone 4

* Correction convert_timezone 5

* Correction convert_timezone 6

* Correction convert_timezone 7

* Correction convert_timezone 8

* Correction convert_timezone 9

* Correction convert_timezone 10

* Correction convert_timezone 11

* Correction convert_timezone 12

* Correction convert_timezone 12

* Correction convert_timezone 13

* Unit test

* Unit test 2

* Unit test 3

* Unit test 4

* Unit test 5

* Unit test 6

* Unit test 7

* feat: convert_timezone(target_timezone, ts)

* add some check

* if error output push default

---------

Co-authored-by: TCeason <[email protected]>
* feat(functions): add new function: map_pick

* feat(functions): add factory function for map_pick

* feat(functions): add more args_type check

* feat(functions): add args arrayType

* fix

* fix

* fix tests

* fix tests

---------

Co-authored-by: baishen <[email protected]>
* refactor(storage): refactor read virtual columns

* fix typos

* fix
)

* refactor: remove `location_prefix`

no longer supported

* tweak stateless test case

* tweak test cases

* tweak logic test
* chore: tweak batch deletion concurrency

* chore: tweak remove file in batch thread pool size
* feat(functions): add map_insert function

* feat(functions): check ci

* feat(functions): domain fix

* feat(functions): add new params format in map_insert

* feat(functions): cargo fmt

* feat(functions): fix NULL mapType in insert

* fix

* fix tests

* fix typos

---------

Co-authored-by: baishen <[email protected]>
* feat: filter null value before join

* fix lint

* add annotations and process possible crash

* dedup filters and fix tests (also need to fix native explain test)

* fix test

* support semi join

* fix test for semi join

* adjust threshold and enable only distribution
* feat: show dictionaries stmt,planner.

* feat: add storages dictionaries

* feat: dictionaries_table.

* update: disctionaries_table and binder.

* fix

* fix

* fix and test.

* fmt

* update.

* update binder and test.

* update privilege_access and testdata.

* feat: rename dictionary.

* fix: schema_api_impl and fmt

* fix

* fix

* feat: stmt

* update:stmt

* feat interpreters.

* fix.

* update test.

* fix: api & interface

* fix

---------

Co-authored-by: winnie-wenli <[email protected]>
* add date function

* add tests

* add tests
* chore: remove obsolete version

* z
* refactor: adjust response of login handler.

* update tests.

* fix: session id miss match

* feat: logging of logout request.

* fix
* feat: implement StringColumn using StringViewArray

* fix

* convert binaryview between arrow1 and arrow2

* fix

* fix

* fix

* fix

* fix

* fix some issue

* fix view slice bug

* fix view slice bug

* fix

* support native read write

* fix

* fix

* fix tests

* add with_data_type

* add with_data_type

* fix gen_random_uuid commit row

* move record batch to block

* remove unused dep

* fix lint

* fix commit row

* fix commit row

* fix size

* fix size

* add NewBinaryColumnBuilder and NewStringColumnBulder

* fix incorrect serialize_size

* fix incorrect serialize_size

* lint

* lint

* fix tests

* use binary state

* use binary state

* update tests

* update tests

* update tests

* fix native view encoding

* fix

* [ci skip] updata kernel concat for view types

* [ci skip] improve kernels for view types

* [ci skip] only string type use string view type

* [ci skip] only string type use string view type

* fix tests

* [ci skip] fix tests

* [ci skip] fix

* fix

* use NewStringColumnBuilder

* rename NewString -> String

* fmt

* [ci skip] update tests

* optimize take

* add bench

* fix tests

* update

* improve compare

* implement compare using string view prefix

* fix

* fix

* fix

* fix-length

* disable spill

* [ci skip] add put_and_commit

* [ci skip] update

* update test

* lint

* [ci skip] add maybe gc

* fix endiness

* fix endiness

* fix

* update string compare

* update

---------

Co-authored-by: sundy-li <[email protected]>
* fix: clustering_information panic if string domain is none

* make lint

---------

Co-authored-by: Winter Zhang <[email protected]>
To avoid redundant extraction of snapshot location from hint file, a
snapshot location cache is added at the table instance level for tables
that are attached to another table.
sundy-li and others added 30 commits December 26, 2024 09:36
* chore(query): add fuzz aggregate tests

* chore(query): fix union projection

* chore(query): add fuzz union

* chore(query): fix union

* chore(query): fix union

* chore(query): fix union

* chore(query): fix union

* chore(query): fix union

* update join binder

* update join binder

* update join binder

* update join binder

* chore(query): update tests

* chore(query): fix parser
…17112)

* fix show table

* sql_name_explicit_null

* fix

* fix
* feat(query): Add `external_block_rows` metrics

* fix

* add init_semaphore

* add rows metrics
* Revert "chore: add more log (#17110)"

This reverts commit 0e05b43.

* Revert "feat: support vacuum leaked table data (#17022)"

This reverts commit 3a9f404.
… caused failed (#17127)

fix(query): fix udf script return type is array
* chore(query): bump federated mysql version

* Update query.test

change 8.0.26 to 8.0.90

---------

Co-authored-by: wubx <[email protected]>
* chore(query): reduce-functions-code-expand

* chore(query): reduce-functions-code-expand

* chore(query): update

* chore(query): fix
* add method to check sugar function

* compare sugar functions using unicase ascii

* add sqllogictest

* migrate builtin function lookup to unicase

* fix issues

* fix build issue
* chore(query): improve ctx lock

* chore(query): improve vacuum

* send spill nums via progress in cluster

* send spill nums via progress in cluster
…ons during the resolve procedure args (#17119)

fix(query): Disabled the shrink_scalar optimization for cast expressions

Co-authored-by: sundyli <[email protected]>
* chore: simplify alter and drop cluster key logic

* fix
* chore: rename default_cluster_key_id to cluster_key_seq

* fix
* refactor: integrate segment pruning into pipeline

* chore: fix unit test and clean code
* chore(query): fix udf metrics

* chore(query): rename

* chore(query): update

* chore(query): add test parallel params

* chore(query): add test parallel params

* chore(query): add test parallel params

* chore(query): add test parallel params
* feat: add server to admin udfs api

* z
* chore: Split functions crate into multi crates

* split new crate databend-functions-scalar-arithmetic databend-functions-scalar-arithmetic-modulo databend-functions-scalar-datetime databend-functions-scalar-decimal-utils

* split numeric basic arithmetic and other bit arithmetic

* fix ut

* restore int/double arithmetic

* fix
* chore(query): add bump ast 0.1.0

* chore(query): add bump ast 0.1.0

* chore(query): add bump ast 0.1.0

* chore(query): add bump ast 0.1.0

* chore(query): add bump ast 0.1.1

* chore(query): add bump ast 0.1.1

* chore(query): add bump ast 0.1.2

* chore(query): add bump ast 0.1.3

* chore(query): add bump ast 0.1.0

* update

* update

* update

* chore(cli): fix tests

* chore(cli): fix tests

* chore(cli): fix tests
* fix flaky test

* fix

fix
…mise deployments (#17147)

* tweak cargo.toml

* use native_tls in fuse_amend

* sync Cargo.lock

* add settings
* chore: fix cargo check

* taplo fmt
* refactor: Bump OpenDAL to 0.51

Signed-off-by: Xuanwo <[email protected]>

* Remove not needed deps

Signed-off-by: Xuanwo <[email protected]>

* Fix tests

Signed-off-by: Xuanwo <[email protected]>

* Fix tests

Signed-off-by: Xuanwo <[email protected]>

* Address tests

Signed-off-by: Xuanwo <[email protected]>

* Fix part of stage

Signed-off-by: Xuanwo <[email protected]>

* Fix delta table

Signed-off-by: Xuanwo <[email protected]>

* Fix size

Signed-off-by: Xuanwo <[email protected]>

---------

Signed-off-by: Xuanwo <[email protected]>
* feat: add ttc member (tcp testing container)

* feat(ci): add hybrid logictest handler

* feat(ci): add hybrid logictest handler

* feat(ci): add hybrid logictest handler

* update

* update

* update

* fix port

* fix tests

* fix regexp
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.