Remove logic to skip checkpoint save if checkpoint exists

Remove logic to skip checkpoint save if checkpoint exists #1738