[Feature] How to deploy a RayService with deployment to exist RayCluster ?

[xushaoxiao]

Search before asking

• I had searched in the issues and found no similar feature requirement.

Description

Hi teams, i want to deploy directly a application via rayservice to exist raycluster, what can do it ?

Now exist:

Use case

You can asume i have a new application serving by rayserve, the name is rayservice-app-one .

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

[andrewsykim]

You can connect to the Ray cluster and then use serve run to deploy your serve applications

[xushaoxiao]

You can connect to the Ray cluster and then use serve run to deploy your serve applications

via common "deployment" to kuberay cluster

[kevin85421]

For prototyping, you can run serve run. However, for production, you should create a RayService CR with a new RayCluster. To achieve RayService high availability, all Pods must be configured with readiness probes which are different from RayCluster CR.