learning+website: add FlattenWith and Tee to Playground and Transform Catalog [WIP]

[mohamedawnallah]

Description

Python SDK

• Add FlattenWith to Playground
• Add FlattenWith to Transform Catalog
• Add Tee to Playground
• Add Tee to Transform Catalog

Java SDK

• Add FlattenWith to Playground
• Add FlattenWith to Transform Catalog
• Add Tee to Playground
• Add Tee to Transform Catalog

Fixes #32840

---

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

• Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
• Update CHANGES.md with noteworthy changes.
• If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

[mohamedawnallah]

Hi @liferoad and @robertwb,

Is there a convenient way to resolve the following java dependency issues that I'm encountering? 🙏

I'm new to Java development and have recently worked with the FlattenWith feature introduced in Apache Beam 2.61.0. However, the current katas learning Java code uses Apache Beam 2.38.0 (link to the code). To align the versions, I compiled a JAR file for Apache Beam Java core from source using gradle build. The following files were generated in build/libs:

beam-sdks-java-core-2.61.0-SNAPSHOT-tests-unshaded.jar
beam-sdks-java-core-2.61.0-SNAPSHOT-tests.jar
beam-sdks-java-core-2.61.0-SNAPSHOT-unshaded.jar
beam-sdks-java-core-2.61.0-SNAPSHOT.jar

Next, I copied beam-sdks-java-core-2.61.0-SNAPSHOT-unshaded.jar into the katas learning Java modules in IntelliJ, and it recognized the FlattenWith operations. However, when I tried to run it, I encountered dependency issues, specifically:

Caused by: java.lang.ClassNotFoundException: org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.collect.SortedSetMultimap

I’ve found myself in dependency hell and am unsure if this is the right approach. Any help you can provide would be greatly appreciated! Thank you!

[robertwb]

Thanks for doing this!

You probably need to update guava (and the other files) to the versions Beam uses, which can be found at https://github.com/apache/beam/blob/release-2.60.0/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy#L616

I'm not sure how to depend on a pre-release version of beam (other than copying java files as you did for testing). That's a downside for having this be in a separate repository.

[robertwb]

Perhaps this'll be easier now that this is in the official release.

[mohamedawnallah]

Hi @robertwb,

Apologies for the delayed response to this PR. I've been finishing up my current internship but will address the feedback over the weekend. 🙏

[mohamedawnallah]

Hi @robertwb, I think the PR is now ready for review. I would love to receive any feedback! 🙏