[Failing Test]: PreCommit YAML Xlang Direct fails on GHA

[tvalentyn]

What happened?

Sample run: https://github.com/apache/beam/actions/runs/9087570294/job/24975542386

Stacktrace:

INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Exception in thread "main" java.lang.NoClassDefFoundError: org/slf4j/LoggerFactory

INFO     root:external.py:1017 Starting a JAR-based expansion service from JAR /runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting service with ['java' '-jar' '/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar' '41523' '--filesToStage=/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar' '--alsoStartLoopbackWorker']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Exception in thread "main" java.lang.NoClassDefFoundError: org/slf4j/LoggerFactory
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	at org.apache.beam.sdk.expansion.service.ExpansionService.<clinit>(ExpansionService.java:115)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Caused by: java.lang.ClassNotFoundException: org.slf4j.LoggerFactory
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	at java.lang.ClassLoader.loadClass(ClassLoader.java:419)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	at java.lang.ClassLoader.loadClass(ClassLoader.java:352)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	... 1 more
ERROR    apache_beam.utils.subprocess_server:subprocess_server.py:174 Started job service with ['java', '-jar', '/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar', '41523', '--filesToStage=/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar', '--alsoStartLoopbackWorker']
ERROR    apache_beam.utils.subprocess_server:subprocess_server.py:188 Error bringing up service
Traceback (most recent call last):
  File "/runner/_work/beam/beam/sdks/python/apache_beam/utils/subprocess_server.py", line 175, in start
    raise RuntimeError(
RuntimeError: Service failed to start up with error 1
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:339 Unknown pipeline options received: -v,apache_beam/yaml/integration_tests.py,--deselect,apache_beam/yaml/integration_tests.py::BigqueryTest::test_ReadFromBigQuery_ExternalJavaProvider_0. Ignore if flags are used for internal purposes.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:364 Discarding flag -v, single dash flags are not allowed.
INFO     root:external.py:1017 Starting a JAR-based expansion service from JAR /runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar 
ERROR    apache_beam.utils.subprocess_server:subprocess_server.py:174 Started job service with ['java', '-jar', '/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar', '41523', '--filesToStage=/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar', '--alsoStartLoopbackWorker']
ERROR    apache_beam.utils.subprocess_server:subprocess_server.py:188 Error bringing up service

More failures: https://github.com/apache/beam/actions/workflows/beam_PreCommit_Yaml_Xlang_Direct.yml

Issue Failure

Failure: Test is permared

Issue Priority

Priority: 1

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam YAML
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Spark Runner
• Component: Flink Runner
• Component: Samza Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner

[tvalentyn]

Couldn't repro locally. gradlew :sdks:python:yamlIntegrationTests passed for me.

[damccorm]

Looks like this is back to green - https://github.com/apache/beam/actions/workflows/beam_PreCommit_Yaml_Xlang_Direct.yml?query=event%3Aschedule and probably safe to close? @tvalentyn feel free to reopen if you disagree