Improve the retry of the rpc client

[SimFG]

issue: #26793
pr: #26795

[mergify]

@SimFG Thanks for your contribution. Please submit with DCO, see the contributing guide https://github.com/milvus-io/milvus/blob/master/CONTRIBUTING.md#developer-certificate-of-origin-dco.

[mergify]

@SimFG ut workflow job failed, comment rerun ut can trigger the job again.

[mergify]

@SimFG ut workflow job failed, comment rerun ut can trigger the job again.

[mergify]

@SimFG ut workflow job failed, comment rerun ut can trigger the job again.

[mergify]

@SimFG ut workflow job failed, comment rerun ut can trigger the job again.

[mergify]

@SimFG ut workflow job failed, comment rerun ut can trigger the job again.

[mergify]

@SimFG ut workflow job failed, comment rerun ut can trigger the job again.

[mergify]

@SimFG ut workflow job failed, comment rerun ut can trigger the job again.

[codecov]

Codecov Report

Merging #26797 (9b36713) into 2.2.0 (8ee4ca5) will increase coverage by 0.04%.
Report is 2 commits behind head on 2.2.0.
The diff coverage is 80.41%.

@@            Coverage Diff             @@
##            2.2.0   #26797      +/-   ##
==========================================
+ Coverage   80.93%   80.98%   +0.04%     
==========================================
  Files         745      745              
  Lines      109188   109111      -77     
==========================================
- Hits        88372    88360      -12     
+ Misses      17463    17401      -62     
+ Partials     3353     3350       -3     

Files Changed	Coverage Δ
internal/distributed/datacoord/client/client.go	74.06% <ø> (-0.05%)	⬇️
internal/distributed/datanode/client/client.go	77.24% <ø> (-0.12%)	⬇️
internal/distributed/indexcoord/client/client.go	52.84% <ø> (-0.25%)	⬇️
internal/distributed/indexnode/client/client.go	76.37% <ø> (-0.19%)	⬇️
internal/distributed/proxy/client/client.go	86.95% <ø> (-0.09%)	⬇️
internal/distributed/querycoord/client/client.go	80.37% <ø> (-0.06%)	⬇️
internal/distributed/querynode/client/client.go	90.94% <ø> (-0.04%)	⬇️
internal/distributed/rootcoord/client/client.go	90.87% <ø> (-0.43%)	⬇️
internal/querycoordv2/server.go	77.54% <0.00%> (ø)
internal/util/grpcclient/client.go	75.00% <78.66%> (+1.90%)	⬆️
... and 5 more

... and 18 files with indirect coverage changes

[SimFG]

rerun ut

[mergify]

@SimFG E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[SimFG]

/run-cpu-e2e

[xiaofan-luan]

/lgtm
/approved

[congqixia]

/approve

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: congqixia, SimFG

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [congqixia]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment