Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

你好,我想问加上这个input_pertub之后是否会影响加载之前训练过的checkpoint呢? #30

Open
wwj723452017 opened this issue Jul 10, 2024 · 1 comment

Comments

@wwj723452017
Copy link

例如guided-diffusion给出的pt文件。

另外我想请问readme里面没有给出256的训练,请问是在256*256大小训练效果不是很好吗?
谢谢

@forever208
Copy link
Owner

forever208 commented Jul 10, 2024

@wwj723452017 如果我没理解错的话,你是想问,在预训练好的原 diffusion 模型基础上再 input_pertub 微调,效果是否会好吗? 这个我没试过,但是理论上肯定是会改善原有 diffusion 模型的

另外,256的我也试过,效果也很好,只是当时卡有限,没训练完,就没放进论文里了。

如果你想试试 input_perturb 在 256 /512 上的效果,你可以直接用 LDM 的代码去做训练,会快很多,加上 IP 也会带来很大提升。256 在 pixel 层面上做扩散太 expensive 了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants