Support using different streams in one infer request with latency mode #37305
Job | Run time |
---|---|
16s | |
52s | |
20m 55s | |
0s | |
0s | |
1m 42s | |
2m 48s | |
5m 6s | |
2m 39s | |
7m 56s | |
4m 17s | |
1m 51s | |
3m 18s | |
0s | |
5m 23s | |
1s | |
57m 4s |
Job | Run time |
---|---|
16s | |
52s | |
20m 55s | |
0s | |
0s | |
1m 42s | |
2m 48s | |
5m 6s | |
2m 39s | |
7m 56s | |
4m 17s | |
1m 51s | |
3m 18s | |
0s | |
5m 23s | |
1s | |
57m 4s |