Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[编程挑战季] 开发对接大模型 Adapter。 #51

Open
peng3307165 opened this issue Oct 17, 2024 · 2 comments
Open

[编程挑战季] 开发对接大模型 Adapter。 #51

peng3307165 opened this issue Oct 17, 2024 · 2 comments
Assignees

Comments

@peng3307165
Copy link
Collaborator

peng3307165 commented Oct 17, 2024

  1. 问题简述
    提供大模型一键对接ModelCache能力,包括Cache引流控制,大模型调用,缓存查询,数据回写等能力。
    其中的大模型调用规范基于OpenAI规范,参考:https://platform.openai.com/docs/api-reference/chat/create
  2. 期望产出
    Adapter模块,能够接收用户请求,在Cache中查询是否命中,并调用大模型服务。解析返回,回写缓存。
  3. 能力要求
    熟悉python代码,具备基础的fast api开发能力
@peng3307165 peng3307165 changed the title [ModelCache] 开发对接大模型 Adapter。 [编程挑战季] 开发对接大模型 Adapter。 Nov 13, 2024
@DreamCyc
Copy link

Please assign this to me,I will develop adapter module and implement objective functions.

@peng3307165 peng3307165 moved this from Todo to In Progress in CodeFuse编码挑战季 Nov 13, 2024
@DreamCyc
Copy link

目前状况:测试Modelcache框架,本地测试接口中

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: In Progress
Development

No branches or pull requests

2 participants