New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for o1-preview and o1-mini openai models #390

Open

vadim-ivlev opened this issue Nov 16, 2024 · 1 comment

Labels

vadim-ivlev commented Nov 16, 2024

o1-preview and o1-mini openai models don't support stream=true option.

Consequently it is impossible to use them.

Please include an option to switch stream on and off for a model.

vadim-ivlev added the enhancement label

roychri commented Dec 11, 2024

o1-mini and o1-preview supports streaming now. Actually since 5 days after your op.
https://community.openai.com/t/openai-o1-streaming-now-available-api-access-for-tiers-1-5/1025430

But I agree that we should have the ability to turn it on or off using a cli option argument.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment