bug: Windows: "Nitro process exited. 1" when trying to run Inference

[dan-homebrew]

Describe the bug

• I encounter a bug where Nitro process exits immediately when trying to load model
• See screenshot below

To Reproduce
Steps to reproduce the behavior:

1. Run Jan and download tinyllama
2. Send a message to Jan using tinyllama

Screenshots

Desktop (please complete the following information):

• OS and Hardware (please see below)
• 11th Gen Intel, 16gb RAM
• Windows 10 Pro
  

Additional context
Add any other context about the problem here.

[dan-homebrew]

@linhtran174 I'm reassigning this task to you

[linhtran174]

Mistakenly linked to another merged PR, re-opening this

[linhtran174]

I cannot reproduce this on my Windows PC, also tried a fresh clone and build on Hiro's laptop, download tinyllama and it works perfectly:

Hiro's laptop spec:

[louis-jan]

@linhtran174 please give the possible root cause we mentioned. Old tinylama models spec contains empty ai_prompt and user_prompt which lead to nitro crash. @dan-jan please check if this is the case. Delete /models does help with @linhtran174 case.

[linhtran174]

Ty for supplementing. As root cause is found, I will close the ticket with summry:

• Cause: legacy model spec not compatible with new spec
• Solution: Delete /models in JAN_ROOT and restart