[RayService][Refactor] ServeConfigs memory leak

[kevin85421]

Search before asking

• I had searched in the issues and found no similar feature requirement.

Description

kuberay/ray-operator/controllers/ray/rayservice_controller.go

Line 60 in f3353b2

ServeConfigs cmap.ConcurrentMap[string, string]

ServeConfigs is used to determine whether the RayService controller should send a request to the Ray head to create or update Ray Serve applications. However, the key in the map is not removed after the RayService CR is deleted, causing a memory leak.

Possible solutions:

1. Add a finalizer to the RayService CR, clean up the cache, and then remove the finalizer.
2. Use an LRU cache.

Use case

No response

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!