Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Allow using any OpenAI-compatible mode #13

Open
arsaboo opened this issue Dec 23, 2024 · 2 comments
Open

[Feature] Allow using any OpenAI-compatible mode #13

arsaboo opened this issue Dec 23, 2024 · 2 comments

Comments

@arsaboo
Copy link

arsaboo commented Dec 23, 2024

Currently, the model="gpt-4o" is hardcoded in the code. We should allow using any OpenAI-compatible model. This will allow users to use other providers (e.g., OpenRouter) and even local models.

@jacks-sam1010
Copy link

Hello, we tried to solve the issue.

This is what we did:

Modified the code to allow using any OpenAI-compatible model instead of hardcoding 'gpt-4o'. Added a command-line argument to specify the model and updated the LLM initialization.

You can review changes in this commit: jacks-sam1010@929196a.

Caution

Disclaimer: The concept of solution was created by AI and you should never copy paste this code before you check the correctness of generated code. Solution might not be complete, you should use this code as an inspiration only.


Latta AI seeks to solve problems in open source projects as part of its mission to support developers around the world. Learn more about our mission at https://latta.ai/ourmission . If you no longer want Latta AI to attempt solving issues on your repository, you can block this account.

@arsaboo
Copy link
Author

arsaboo commented Dec 23, 2024

@jacks-sam1010 Can you create a PR with those changes? Instead of (or in addition to) using CLI to specify the model, we should use the .env file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants