Your result seems to be incorrect

[JinglUO703]

When I reloaded mv_bast.pth, the actual verification results were inconsistent with the results reported in the log.

This seems to be related to your verification code. You directly used DDP and reported the result of rank=0. Are you sure this is correct?

And when batch_size changes, the verification results will also change. Please explain this problem or provide a standard verification code. Thank you

[JinglUO703]

Where is your all_gather or all_reduce function???