Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Simple query fails with column types must match schema types #13534

Closed
adriangb opened this issue Nov 22, 2024 · 3 comments · Fixed by #13535
Closed

Simple query fails with column types must match schema types #13534

adriangb opened this issue Nov 22, 2024 · 3 comments · Fixed by #13535
Labels
bug Something isn't working

Comments

@adriangb
Copy link
Contributor

Describe the bug

Found in our production system using datafusion internals, but reproducible in datafusion-cli:

SELECT
    'foo' AS text,
    arrow_cast('2024-01-01T00:00:00Z'::timestamptz, 'Timestamp(Microsecond, Some("UTC"))') AS ts
GROUP BY ts, text

Gives:

Arrow error: Invalid argument error: column types must match schema types, expected Timestamp(Microsecond, Some("UTC")) but found Timestamp(Microsecond, None) at column index 0

To Reproduce

No response

Expected behavior

No response

Additional context

I bisected it with this script:

pushd datafusion-cli && cargo run --bin datafusion-cli -- --file ../q.sql && popd

And then:

git checkout c0ca4b4  # current HEAD
git bisect start
git bisect bad
git checkout 88f58bf # 43.0, I manually verified it is okay
git bisect good
git bisect run ./test.sh  # the above script

The result points to ecc04d4 / #13457
@adriangb adriangb added the bug Something isn't working label Nov 22, 2024
@adriangb
Copy link
Contributor Author

cc @jonathanc-n @jayzhan211 @alamb

@jayzhan211 jayzhan211 mentioned this issue Nov 23, 2024
Merged
@alamb
Copy link
Contributor

alamb commented Nov 23, 2024 •
edited
Loading

@jayzhan211 is on the case ❤️

@alamb alamb added the regression Something that used to work no longer does label Nov 23, 2024
@alamb
Copy link
Contributor

alamb commented Nov 23, 2024

I think this issue was introduced in

Which has not been released yet

@alamb alamb removed the regression Something that used to work no longer does label Nov 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Set timezone for group column timestamp type jayzhan211/datafusion
2 participants
@alamb @adriangb