Skip to content

Commit

Permalink
Remove the default machine types (#33191)
Browse files Browse the repository at this point in the history
From #30507 (comment), try to use the default machine types for Flink with more memory.
  • Loading branch information
liferoad authored Nov 22, 2024
1 parent b70375d commit d342dd3
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions .test-infra/dataproc/flink_cluster.sh
Original file line number Diff line number Diff line change
Expand Up @@ -131,10 +131,8 @@ function create_cluster() {

# Docker init action restarts yarn so we need to start yarn session after this restart happens.
# This is why flink init action is invoked last.
# TODO(11/11/2022) remove --worker-machine-type and --master-machine-type once N2 CPUs quota relaxed
# Dataproc 2.1 uses n2-standard-2 by default but there is N2 CPUs=24 quota limit
gcloud dataproc clusters create $CLUSTER_NAME --region=$GCLOUD_REGION --num-workers=$FLINK_NUM_WORKERS --public-ip-address \
--master-machine-type=n1-standard-2 --worker-machine-type=n1-standard-2 --metadata "${metadata}", \
--metadata "${metadata}", \
--image-version=$image_version --zone=$GCLOUD_ZONE --optional-components=FLINK,DOCKER --quiet
}

Expand Down

0 comments on commit d342dd3

Please sign in to comment.