Support using different streams in one infer request with latency mode #12397
| Job | Run time |
|---|---|
| 27s | |
| 55s | |
| 41m 2s | |
| 4m 10s | |
| 2m 33s | |
| 4m 3s | |
| 5m 6s | |
| 7m 6s | |
| 31m 35s | |
| 22m 21s | |
| 1s | |
| 1h 59m 19s |
| Job | Run time |
|---|---|
| 27s | |
| 55s | |
| 41m 2s | |
| 4m 10s | |
| 2m 33s | |
| 4m 3s | |
| 5m 6s | |
| 7m 6s | |
| 31m 35s | |
| 22m 21s | |
| 1s | |
| 1h 59m 19s |