vLLM model handler efficiency improvements #29754
Job | Run time |
---|---|
34s | |
2m 2s | |
22m 53s | |
0s | |
15m 59s | |
23m 17s | |
15m 31s | |
20m 21s | |
24s | |
23s | |
22s | |
19s | |
2m 58s | |
24s | |
29s | |
31s | |
26s | |
0s | |
5m 0s | |
33s | |
43s | |
53s | |
55s | |
50m 20s | |
0s | |
0s | |
0s | |
2h 45m 17s |
Job | Run time |
---|---|
34s | |
2m 2s | |
22m 53s | |
0s | |
15m 59s | |
23m 17s | |
15m 31s | |
20m 21s | |
24s | |
23s | |
22s | |
19s | |
2m 58s | |
24s | |
29s | |
31s | |
26s | |
0s | |
5m 0s | |
33s | |
43s | |
53s | |
55s | |
50m 20s | |
0s | |
0s | |
0s | |
2h 45m 17s |