Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Avro] Use "extensions/avro" instead of avro from"core" in Java SDK modules #24992

Merged
merged 13 commits into from
Feb 22, 2023

Conversation

aromanenko-dev
Copy link
Contributor

@aromanenko-dev aromanenko-dev commented Jan 13, 2023

Make all Beam Java SDK modules, that depend on Avro, use Avro extension instead of Avro from core.

It should not introduce any breaking changes for users.

Closes #24748


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests
Go tests

See CI.md for more information about GitHub Actions CI.

@olehborysevych
Copy link
Collaborator

@aromanenko-dev looking into failing Example check. Sorry for inconvenience (

@aromanenko-dev
Copy link
Contributor Author

Run Java_Kafka_IO_Direct PreCommit

@aromanenko-dev
Copy link
Contributor Author

Run SQL_Java17 PreCommit

@aromanenko-dev
Copy link
Contributor Author

Run Java_GCP_IO_Direct PreCommit

@aromanenko-dev
Copy link
Contributor Author

Run SQL PreCommit

@aromanenko-dev
Copy link
Contributor Author

Run SQL_Java11 PreCommit

@aromanenko-dev
Copy link
Contributor Author

Run Java_Kafka_IO_Direct PreCommit

@github-actions github-actions bot added the gcp label Jan 17, 2023
@aromanenko-dev
Copy link
Contributor Author

Run SQL PreCommit

@Abacn
Copy link
Contributor

Abacn commented Feb 20, 2023

Java11/Java17 test failures are due to #23210, see investigation done in #25566

@aromanenko-dev
Copy link
Contributor Author

aromanenko-dev commented Feb 21, 2023

@Abacn Do you have an idea when it can be fixed? Do you think we have to wait for a fix before merging this one?

@Abacn
Copy link
Contributor

Abacn commented Feb 21, 2023

Thanks @aromanenko-dev for pinning. I think we can proceed given that those failures are understood to be not related. I also opened #25566

@Abacn
Copy link
Contributor

Abacn commented Feb 21, 2023

Run SQL_Java11 PreCommit

@Abacn
Copy link
Contributor

Abacn commented Feb 21, 2023

Run SQL_Java17 PreCommit

@aromanenko-dev
Copy link
Contributor Author

retest this please

@aromanenko-dev
Copy link
Contributor Author

Run Java_GCP_IO_Direct PreCommit

@aromanenko-dev
Copy link
Contributor Author

Run Java_Kafka_IO_Direct PreCommit

@aromanenko-dev
Copy link
Contributor Author

Run Java_HCatalog_IO_Direct PreCommit

@aromanenko-dev
Copy link
Contributor Author

I merge this one since failed checks are not related and all others are green.

@aromanenko-dev aromanenko-dev merged commit 95a6566 into apache:master Feb 22, 2023
lostluck pushed a commit to lostluck/beam that referenced this pull request Feb 22, 2023
…odules (apache#24992)

* Use "extensions/avro" instead of avro from"core" in Java SDK modules

* Use "extensions/avro" instead of avro from"core" in sdks/java/io/kafka

* Use "extensions/avro" instead of avro from"core" in sdks/java/io/google-cloud-platform

* Resolve rebase conflicts

* Use "extensions/avro" for Dataflow runner

* Use "extensions/avro" for core-construction runner

* Add avro extension as a dependency for direct runner

* Copy Avro-related tests to Avro extension

* Address review comments

* Depend javaPreCommit on extensions:avro

* Address review comments

* Revert CountingSource.java

* Up-to-date Avro usages
ruslan-ikhsan pushed a commit to akvelon/beam that referenced this pull request Mar 10, 2023
…odules (apache#24992)

* Use "extensions/avro" instead of avro from"core" in Java SDK modules

* Use "extensions/avro" instead of avro from"core" in sdks/java/io/kafka

* Use "extensions/avro" instead of avro from"core" in sdks/java/io/google-cloud-platform

* Resolve rebase conflicts

* Use "extensions/avro" for Dataflow runner

* Use "extensions/avro" for core-construction runner

* Add avro extension as a dependency for direct runner

* Copy Avro-related tests to Avro extension

* Address review comments

* Depend javaPreCommit on extensions:avro

* Address review comments

* Revert CountingSource.java

* Up-to-date Avro usages
@aromanenko-dev aromanenko-dev deleted the avro_24756 branch March 20, 2023 15:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Task]: [Avro] Use "extensions/avro" instead of avro from"core" in Java SDK modules
4 participants