E2E accuracy

E2E accuracy with new check models mode #358

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
Setup	1s
Print inputs	1s
Run test matrix (huggingface, inference, amp_bf16) / Test huggingface amp_bf16 inference accuracy	15m 27s
Run test matrix (huggingface, inference, bfloat16) / Test huggingface bfloat16 inference accuracy	15m 20s
Run test matrix (huggingface, inference, amp_fp16) / Test huggingface amp_fp16 inference accuracy	14m 16s
Run test matrix (huggingface, inference, float32) / Test huggingface float32 inference accuracy	14m 54s
Run test matrix (huggingface, inference, float16) / Test huggingface float16 inference accuracy	15m 20s
Run test matrix (huggingface, inference-no-freezing, bfloat16) / Test huggingface bfloat16 inference-no-freezing accuracy	13m 34s
Run test matrix (huggingface, inference-no-freezing, float16) / Test huggingface float16 inference-no-freezing accuracy	14m 47s
Run test matrix (huggingface, inference-no-freezing, amp_fp16) / Test huggingface amp_fp16 inference-no-freezing accuracy	8m 56s
Run test matrix (huggingface, inference-no-freezing, float32) / Test huggingface float32 inference-no-freezing accuracy	8m 10s
Run test matrix (huggingface, inference-no-freezing, amp_bf16) / Test huggingface amp_bf16 inference-no-freezing accuracy	7m 34s
Run test matrix (huggingface, training, amp_bf16) / Test huggingface amp_bf16 training accuracy	7m 10s
Run test matrix (huggingface, training, amp_fp16) / Test huggingface amp_fp16 training accuracy	7m 29s
Run test matrix (huggingface, training, bfloat16) / Test huggingface bfloat16 training accuracy	7m 10s
Run test matrix (huggingface, training, float32) / Test huggingface float32 training accuracy	7m 3s
Run test matrix (huggingface, training, float16) / Test huggingface float16 training accuracy	1s
	2h 37m 13s