Skip to content

Fix the fake parallel states init with moe parallel folding. #6633

Fix the fake parallel states init with moe parallel folding.

Fix the fake parallel states init with moe parallel folding. #6633

L2_Megatron_GPT_Pretraining_and_Resume_Training_TP2  /  main

succeeded Nov 28, 2024 in 3m 29s