-
Notifications
You must be signed in to change notification settings - Fork 397
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Bump storage common and storage common parent version to include hive 2.3.9 fix #597
base: 10.0.x
Are you sure you want to change the base?
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
@kpatelatwork @BlueEldur |
@kaushiksrinivas Yes there are plans to resolve this, but we haven't quite had the bandwidth yet to investigate why the version bump is breaking ITs yet. We are aware of this breaking issue though. Sorry for the delay. |
@BlueEldur , |
@BlueEldur |
|
@kaushiksrinivas |
Problem
Hive 2.3.7 breaks the connector as described #578
We verified the repro and bumped hive in the parent here confluentinc/kafka-connect-storage-common#213
but we didn't upgrade the dependency in the hdfs connector
Solution
bump and realign the dependencies
Does this solution apply anywhere else?
If yes, where?
hdfs3 connector
Test Strategy
[INFO] +- io.confluent:kafka-connect-storage-hive🫙10.1.4:compile
[INFO] | +- org.apache.hive.hcatalog:hive-hcatalog-core:jar:2.3.9:compile
[INFO] | | +- org.apache.hive:hive-cli:jar:2.3.9:compile
[INFO] | | | +- org.apache.hive:hive-serde:jar:2.3.9:compile
[INFO] | | | | +- org.apache.hive:hive-service-rpc:jar:2.3.9:compile
[INFO] | | | - org.apache.hive:hive-service:jar:2.3.9:compile
[INFO] | | | +- org.apache.hive:hive-llap-server:jar:2.3.9:compile
[INFO] | | | | +- org.apache.hive:hive-llap-common:test-jar:tests:2.3.9:compile
[INFO] | | +- org.apache.hive:hive-common:jar:2.3.9:compile
[INFO] | | | +- org.apache.hive:hive-storage-api🫙2.4.0:compile
[INFO] | | +- org.apache.hive:hive-metastore:jar:2.3.9:compile
[INFO] | | - org.apache.hadoop:hadoop-archives:jar:2.7.2:compile
[INFO] | +- org.apache.hive:hive-exec:jar:core:2.3.9:compile
[INFO] | | +- org.apache.hive:hive-vector-code-gen:jar:2.3.9:compile
[INFO] | | +- org.apache.hive:hive-llap-tez:jar:2.3.9:compile
[INFO] | | | - org.apache.hive:hive-llap-client:jar:2.3.9:compile
[INFO] | | | - org.apache.hive:hive-llap-common:jar:2.3.9:compile
[INFO] | | +- org.apache.hive:hive-shims:jar:2.3.9:compile
[INFO] | | | +- org.apache.hive.shims:hive-shims-common:jar:2.3.9:compile
[INFO] | | | +- org.apache.hive.shims:hive-shims-0.23:jar:2.3.9:runtime
[INFO] | | | - org.apache.hive.shims:hive-shims-scheduler:jar:2.3.9:runtime
Testing done:
Release Plan
backporting to 10.0.x, and releasing both 10.0.x and 10.1.x.