Kafka SchemaTransform translation

[ahmedabu98]

Adding SchemaTransform translation and tests for KafkaIO

[github-actions]

Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment assign set of reviewers

[github-actions]

Assigning reviewers. If you would like to opt out of this review, comment assign to next reviewer:

R: @kennknowles for label java.
R: @chamikaramj for label io.

Available commands:

• stop reviewer notifications - opt out of the automated review tooling
• remind me after tests pass - tag the comment author after tests pass
• waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

[ahmedabu98]

R: @chamikaramj
R: @damccorm

[github-actions]

Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control

[chamikaramj]

Thanks. LGTM.

[chamikaramj]

Could you clarify why this sorting is needed ? Do we need to do this for every implementation ?

[ahmedabu98]

This is just to keep in line with what TypedSchemaTransformProvider does when producing a config schema:

beam/sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/transforms/TypedSchemaTransformProvider.java

Line 96 in f67f95c

return SchemaRegistry.createDefault().getSchema(configurationClass()).sorted().toSnakeCase();

This is due to the SchemaProvider not always producing a consistent schema (#24361). So we sort to keep it consistent

Do we need to do this for every implementation

Right now unfortunately yes. I'm working on adding some things to SchemaTransform (#30943) to avoid having to copy this everywhere. My hope is this change will make SchemaTransformTranslation sufficient for all and help avoid needing a SchemaTransformTranslation for each IO.