Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RuntimeError: probability tensor contains either inf, nan or element < 0 #50

Open
HassanBinAli opened this issue Feb 11, 2023 · 2 comments

Comments

@HassanBinAli
Copy link

Hi! I have finetuned inverse paraphraser on custom dataset. Model has been saved. Now I am trying to load this model by running demo_paraphraser.py but it's giving
RuntimeError: probability tensor contains either inf, nan or element < 0
Essentially, this error is occurring when line number 313 of style_paraphrase/utils.py starts running. This line is
next_token = torch.multinomial(F.softmax(filtered_logits, dim=-1), num_samples=1)
Found some solutions but they didn't work. One of those solutions is to replace above line with the following
next_token = torch.multinomial(F.softmax(filtered_logits, dim=-1), num_samples=num_samples).
Also tried downgrading torch to 1.1.0 but the files in saved model with extension .bin are unable to be loaded with versions smaller than 1.6.0.
Any help in this regard will be appreciated.

@TufailAhmadSiddiq
Copy link

Hi! I have finetuned inverse paraphraser on custom dataset. Model has been saved. Now I am trying to load this model by running demo_paraphraser.py but it's giving RuntimeError: probability tensor contains either inf, nan or element < 0 Essentially, this error is occurring when line number 313 of style_paraphrase/utils.py starts running. This line is next_token = torch.multinomial(F.softmax(filtered_logits, dim=-1), num_samples=1) Found some solutions but they didn't work. One of those solutions is to replace above line with the following next_token = torch.multinomial(F.softmax(filtered_logits, dim=-1), num_samples=num_samples). Also tried downgrading torch to 1.1.0 but the files in saved model with extension .bin are unable to be loaded with versions smaller than 1.6.0. Any help in this regard will be appreciated.

I am also facing the same error. Here is the screenshot as well.
probability tensor inf error

@martiansideofthemoon
Copy link
Owner

I don't think the model is training since it's outputting !!!!!!!! as the greedy sample.. Did you download the paraphrase generator correctly? Make sure you can paraphrase with the pretrained model first https://github.com/martiansideofthemoon/style-transfer-paraphrase/blob/master/README_terminal_demo.md

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants