Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Add support for Groq API #45

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

Panchajanya1999
Copy link
Contributor

Adding support for Groq API [groq.com] [console.groq.com]

Advantage:

Free for this usage
Uses LPU, which is pretty fast
Fun!

Timeline: [will update it]
July 20, 12:00 PM - Code works perfectly, not yet documented

@Panchajanya1999 Panchajanya1999 marked this pull request as ready for review July 20, 2024 17:00
@tom-doerr
Copy link
Owner

"Free for this usage" - does Groq offer a certain number of tokens for free?

@Panchajanya1999
Copy link
Contributor Author

"Free for this usage" - does Groq offer a certain number of tokens for free?

Sorry I missed your comment, Yeah, it is totally free as of now and a new paid plan is on the way. The free plan will stay free forever with daily limits and as per my calculations, the usage is enough for this purpose.

I will continue writing the readme for this PR once I'm done with my schedule.

Have a good day.

This is a structural change, no features are added or
deleted.

Signed-off-by: Panchajanya1999 <[email protected]>
@ytinyui
Copy link
Contributor

ytinyui commented Sep 23, 2024

As the codebase has been refactored #52, please adapt to the current implementation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants