Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is it possible to display an intermediate image of the training process, or to restart training again from the intermediate process? #192

Open
gaoming714 opened this issue Jun 5, 2024 · 1 comment

Comments

@gaoming714
Copy link

Excuse me, is it possible to display an intermediate image of the training process, or to restart training again from the intermediate process? I'd like to be able to pause the pipe so that I can do other things in the middle of the process (like getting a new coat) and thus reduce the overall build time.

@levihsu
Copy link
Owner

levihsu commented Jun 12, 2024

Yep. Just save checkpoints and set resume_from_checkpoint in your training script to restart training.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants