Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Difference between show-1-base-0.0 show-1-base? #35

Open
zhizhou57 opened this issue Mar 15, 2024 · 1 comment
Open

Difference between show-1-base-0.0 show-1-base? #35

zhizhou57 opened this issue Mar 15, 2024 · 1 comment

Comments

@zhizhou57
Copy link

When I download show-1 model from huggingface, I found there are two repository: showlab/show-1-base-0.0 and showlab/show-1-base. It seems that their text_encoder have different torch_dtype. For show-1-base, torch_dtype is float32, and for show-1-base-0.0, torch_dtype is float16. Is there other differences between these two repository? And what are these model used for respectively?
Btw I encounter the type error when encode the prompt, expected scalar type Float but found Half

@junhaozhang98
Copy link
Collaborator

(1)unet of base-0.0 is trained on webvid-10M with watermark

(2)base is trained on webvid-10M and finetuned on intervideod dataset without watermark.

Since webvid has a better caption quality, base-0.0 may have better text-video alignment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants