Remove logic to skip checkpoint save if checkpoint exists (#11362)

Remove logic to skip checkpoint save if checkpoint exists (#11362) #144