[Umbrella] RayService HA tests

[kevin85421]

Search before asking

• I had searched in the issues and found no similar feature requirement.

Description

We plan to add tests for RayService HA. The HA tests includes two parts.

• [P0] "Normal cases": In normal cases, no request should be dropped.

  • Static RayCluster [Test][HA] RayService high-availability test without autoscaling enabled #2176
  • [Test][HA] Ray Autoscaler enabled + Ray Serve autoscaling-enabled. #2480
  • [RayService][HA] Test high-availability during zero-downtime upgrade #2517

• [P1] "Chaos cases": In chaos cases, some requests may be dropped.

  • [Feature] RayService HA test - GCS fault tolerance + kill GCS process #2577

• Other:

  • Check status.numServeEndpoints are equal before and after locust test

• [Umbrella] Remove RayService sample YAML Python tests #2518

Use case

No response

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

[CheyuWu]

@kevin85421 I'd like to help with this