Skip to content

Commit

Permalink
Merge pull request #31217: [flink] Add documentation for Flink runner…
Browse files Browse the repository at this point in the history
… versions updates
  • Loading branch information
je-ik authored May 10, 2024
2 parents 365c2d9 + 5ff55b1 commit 0afb52d
Show file tree
Hide file tree
Showing 6 changed files with 19 additions and 5 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@
},
"JavaTestProperties": {
"SUPPORTED_VERSIONS": ["8", "11", "17", "21"],
"FLINK_VERSIONS": ["1.14", "1.15", "1.16", "1.17"],
"FLINK_VERSIONS": ["1.14", "1.15", "1.16", "1.17", "1.18"],
"SPARK_VERSIONS": ["2", "3"]
},
"GoTestProperties": {
Expand Down
2 changes: 1 addition & 1 deletion sdks/go/examples/wasm/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,7 @@ cd $BEAM_HOME
Expected output should include the following, from which you acquire the latest flink runner version.

```shell
'flink_versions: 1.14,1.15,1.16,1.17'
'flink_versions: 1.14,1.15,1.16,1.17,1.18'
```

#### 2. Set to the latest flink runner version i.e. 1.16
Expand Down
2 changes: 1 addition & 1 deletion sdks/python/apache_beam/options/pipeline_options.py
Original file line number Diff line number Diff line change
Expand Up @@ -1591,7 +1591,7 @@ def _add_argparse_args(cls, parser):
class FlinkRunnerOptions(PipelineOptions):

# These should stay in sync with gradle.properties.
PUBLISHED_FLINK_VERSIONS = ['1.14', '1.15', '1.16', '1.17']
PUBLISHED_FLINK_VERSIONS = ['1.14', '1.15', '1.16', '1.17', '1.18']

@classmethod
def _add_argparse_args(cls, parser):
Expand Down
2 changes: 1 addition & 1 deletion sdks/typescript/src/apache_beam/runners/flink.ts
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ import { JavaJarService } from "../utils/service";
const MAGIC_HOST_NAMES = ["[local]", "[auto]"];

// These should stay in sync with gradle.properties.
const PUBLISHED_FLINK_VERSIONS = ["1.14", "1.15", "1.16", "1.17"];
const PUBLISHED_FLINK_VERSIONS = ["1.14", "1.15", "1.16", "1.17", "1.18"];

const defaultOptions = {
flinkMaster: "[local]",
Expand Down
8 changes: 8 additions & 0 deletions settings.gradle.kts
Original file line number Diff line number Diff line change
Expand Up @@ -121,6 +121,14 @@ include(":runners:core-java")
include(":runners:direct-java")
include(":runners:extensions-java:metrics")
/* Begin Flink Runner related settings */
/* When updating these versions, please make sure that the following files are updated as well:
* FLINK_VERSIONS in .github/actions/setup-default-test-properties/test-properties.json
* flink_versions in sdks/go/examples/wasm/README.md
* PUBLISHED_FLINK_VERSIONS in sdks/python/apache_beam/options/pipeline_options.py
* PUBLISHED_FLINK_VERSIONS in sdks/typescript/src/apache_beam/runners/flink.ts
* verify versions in website/www/site/content/en/documentation/runners/flink.md
* verify version in sdks/python/apache_beam/runners/interactive/interactive_beam.py
*/
// Flink 1.14
include(":runners:flink:1.14")
include(":runners:flink:1.14:job-server")
Expand Down
8 changes: 7 additions & 1 deletion website/www/site/content/en/documentation/runners/flink.md
Original file line number Diff line number Diff line change
Expand Up @@ -200,6 +200,7 @@ Starting with Beam 2.18.0, pre-built Flink Job Service Docker images are availab
[Flink 1.15](https://hub.docker.com/r/apache/beam_flink1.15_job_server).
[Flink 1.16](https://hub.docker.com/r/apache/beam_flink1.16_job_server).
[Flink 1.17](https://hub.docker.com/r/apache/beam_flink1.17_job_server).
[Flink 1.18](https://hub.docker.com/r/apache/beam_flink1.18_job_server).
{{< /paragraph >}}

<!-- TODO(BEAM-10214): Use actual lists here and below. -->
Expand Down Expand Up @@ -326,9 +327,14 @@ To find out which version of Flink is compatible with Beam please see the table
<th>Artifact Id</th>
<th>Supported Beam Versions</th>
</tr>
<tr>
<td>1.18.x</td>
<td>beam-runners-flink-1.18</td>
<td>&ge; 2.57.0</td>
</tr>
<tr>
<td>1.17.x</td>
<td>beam-runners-flink-1.16</td>
<td>beam-runners-flink-1.17</td>
<td>&ge; 2.56.0</td>
</tr>
<tr>
Expand Down

0 comments on commit 0afb52d

Please sign in to comment.