fix: 4238 - fix default max_tokens set on remote models

[louis-jan]

Describe Your Changes

I've resolved the issue where it sets the default context_length as the first value for max_tokens.

Fixes Issues

• bug: Wrong max_tokens, preventing users from using some remote models #4238

Changes made

1. models.json:

   • Moved the max_tokens parameter above the temperature parameter for better grouping in two sections of the file.

2. ModelDropdown/index.tsx:

   • Updated overriddenParameters:
     • Changed ctx_len to be undefined if isLocalEngine returns false, otherwise use defaultContextLength.
     • Changed max_tokens to use either the model's max_tokens or defaultContextLength based on whether isLocalEngine returns false.

3. useCreateNewThread.ts:

   • Updated imports to include isLocalEngine.
   • Modified overriddenSettings and overriddenParameters:
     • Changed ctx_len to behave similarly to the changes in ModelDropdown/index.tsx.
     • Changed max_tokens to use either the model's token_limit or defaultContextLength based on whether isLocalEngine returns false.

4. modelEngine.ts:

   • Made isLocalEngine handle an undefined engine by returning false, ensuring safety against calling the method with a null or undefined value.

[github-actions]

Barecheck - Code coverage report

Total: 68.65%

Your code coverage diff: 0.01% ▴

Uncovered files and lines

File	Lines
web/containers/ModelDropdown/index.tsx	102, 113, 123-124, 127, 129-130, 132-133, 135-138, 140, 148, 165-167, 169, 171, 190, 194, 203, 210, 213-214, 249-251, 255, 279-281, 283, 287, 290-295, 302-303, 314, 336, 352, 373, 382, 388, 396-397, 400-405, 408, 411, 463-464, 466, 492, 500, 502, 527, 532-533, 535, 539-541, 543-544, 546, 556-559, 587, 595, 597
web/hooks/useCreateNewThread.ts	43, 45, 50-51, 54-55

[github-actions]

This is the build for this pull request. You can download it from the Artifacts section here: Build URL.

[khanakia]

It is not fixed it's still there in the new version https://github.com/janhq/jan/releases/tag/v0.5.12