[GSOC] `optuna` suggestion service logic update #1128

Job	Run time
e2e (v1.27.11, long-running-resume,from-volume-resume,median-stop)	15m 27s
e2e (v1.27.11, grid,bayesian-optimization,tpe,multivariate-tpe,cma-es,hyperband)	48m 3s
e2e (v1.27.11, hyperopt-distribution)	11m 54s
e2e (v1.27.11, file-metrics-collector,pytorchjob-mnist)	13m 52s
e2e (v1.27.11, median-stop-with-json-format,file-metrics-collector-with-json-format)	13m 33s
e2e (v1.28.7, long-running-resume,from-volume-resume,median-stop)	1m 29s
e2e (v1.28.7, grid,bayesian-optimization,tpe,multivariate-tpe,cma-es,hyperband)	48m 11s
e2e (v1.28.7, hyperopt-distribution)	7m 31s
e2e (v1.28.7, file-metrics-collector,pytorchjob-mnist)	13m 44s
e2e (v1.28.7, median-stop-with-json-format,file-metrics-collector-with-json-format)	12m 16s
e2e (v1.29.2, long-running-resume,from-volume-resume,median-stop)	15m 10s
e2e (v1.29.2, grid,bayesian-optimization,tpe,multivariate-tpe,cma-es,hyperband)	47m 59s
e2e (v1.29.2, hyperopt-distribution)	6m 13s
e2e (v1.29.2, file-metrics-collector,pytorchjob-mnist)	13m 51s
e2e (v1.29.2, median-stop-with-json-format,file-metrics-collector-with-json-format)	13m 14s
	4h 42m 27s

Provide feedback