[Task]: Deprecate Java8

[Abacn]

What needs to happen?

This should be done after #31677

Require Build Beam with Java11+. Therefore enable to use newer gradle plugins that already dropped Java8 support. The released Beam artifact should still keep Java8 compatibility.

Issue Priority

Priority: 2 (default / most normal work should be filed as P2)

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam YAML
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Spark Runner
• Component: Flink Runner
• Component: Samza Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner

[Abacn]

Sent a discussion on beam dev: https://lists.apache.org/thread/w5lf2tg1nlk77so2p39cqphr1gqbh72s

[Abacn]

#31896 : gcs-connector 3 dropped Java 8 support

#32551 : com.pswidersk.terraform-plugin 1.1.1 dropped Java8 support

[Abacn]

This comment tracks current blockers (some test has to run on Java8):

• [Failing Test]: Java Samza runner tests failing on Java11 #32208 Java Samza runner tests failing on Java11
• [Failing Test]: SparkVersionTest 3.4.0+ fails on Java11 #32207 SparkVersionTest 3.4.0+ fails on Java11
• [Failing Test]: Tests involve hive-exec has to run on Java8 #32189 Tests involve hive-exec has to run on Java8

[clairemcginty]

Hi @Abacn, I was wondering if there was any update on dropping java 8! I'm interested in using gcs-connector 3.x with Beam.

[Abacn]

Hi clairemcginty@ I raised this to Beam dev list earlier: https://lists.apache.org/thread/w5lf2tg1nlk77so2p39cqphr1gqbh72s and the feedback is that it's too early to drop Java 8 support at the moment. However Beam already support Java11,17,21 in its most component. If you want to use gcs-connector 3.x, you can configure it in your project dependency

[clairemcginty]

thanks @Abacn! Unfortunately gcs-connector 3.x can't just be bumped on the user side -- there were breaking API changes and the internals of org.apache.beam.sdk.extensions.gcp.util.GcsUtil throw a MethodNotFound error, see here: https://github.com/apache/beam/pull/31898/files#r1678629888 So gcs-connector 3 is blocked on Beam upgrading to Java 11