We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
The text was updated successfully, but these errors were encountered:
Please assign this to me,I will develop adapter module and implement objective functions.
Sorry, something went wrong.
目前状况:测试Modelcache框架,本地测试接口中
DreamCyc
No branches or pull requests
提供大模型一键对接ModelCache能力,包括Cache引流控制,大模型调用,缓存查询,数据回写等能力。
其中的大模型调用规范基于OpenAI规范,参考:https://platform.openai.com/docs/api-reference/chat/create
Adapter模块,能够接收用户请求,在Cache中查询是否命中,并调用大模型服务。解析返回,回写缓存。
熟悉python代码,具备基础的fast api开发能力
The text was updated successfully, but these errors were encountered: