Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

控制台使用run方法流式输出时重复输出之前的内容 #409

Open
zzc-1024 opened this issue Dec 5, 2024 · 1 comment
Open

Comments

@zzc-1024
Copy link

zzc-1024 commented Dec 5, 2024

控制台使用run方法流式输出时重复输出之前的内容。

用户请求: 1+1等于几
2024-12-05 15:22:36,584 - split_query.py - 82 - INFO - Extracted info from query: {"information": ["1+1等于几
2024-12-05 15:22:37,427 - memory.py - 113 - INFO - {"keywords_zh": ["加法", "1", "1"], "keywords_en": ["addition", "1", "1"], "text": "1+1等于几"}
2024-12-05 15:22:37,481 - simple_doc_parser.py - 383 - INFO - Read parsed ./resource/doc.pdf from cache.
2024-12-05 15:22:37,481 - doc_parser.py - 114 - INFO - Start chunking ./resource/doc.pdf (doc.pdf)...
2024-12-05 15:22:37,481 - doc_parser.py - 132 - INFO - Finished chunking ./resource/doc.pdf (doc.pdf). Time spent: 0.0 seconds.
2024-12-05 15:22:37,481 - base_search.py - 56 - INFO - all tokens: 783
2024-12-05 15:22:37,481 - base_search.py - 59 - INFO - use full ref
机器人回应:
[{'content': '1', 'role': 'assistant'}]
机器人回应:
[{'content': '1+', 'role': 'assistant'}]
机器人回应:
[{'content': '1+1', 'role': 'assistant'}]
机器人回应:
[{'content': '1+1等于', 'role': 'assistant'}]
机器人回应:
[{'content': '1+1等于2', 'role': 'assistant'}]
机器人回应:
[{'content': '1+1等于2。', 'role': 'assistant'}]
机器人回应:
[{'content': '1+1等于2。这是一个', 'role': 'assistant'}]
机器人回应:
[{'content': '1+1等于2。这是一个基础', 'role': 'assistant'}]
机器人回应:
[{'content': '1+1等于2。这是一个基础的', 'role': 'assistant'}]
机器人回应:
[{'content': '1+1等于2。这是一个基础的算', 'role': 'assistant'}]
机器人回应:
[{'content': '1+1等于2。这是一个基础的算术', 'role': 'assistant'}]
机器人回应:
[{'content': '1+1等于2。这是一个基础的算术问题', 'role': 'assistant'}]
机器人回应:
[{'content': '1+1等于2。这是一个基础的算术问题。', 'role': 'assistant'}]
机器人回应:
[{'content': '1+1等于2。这是一个基础的算术问题。如果你', 'role': 'assistant'}]

这里似乎是为了兼容前端而设计的接口,建议在这里为控制台场景单独适配一个流式输出接口。

@tuhahaha
Copy link
Collaborator

tuhahaha commented Dec 6, 2024

这里在设计初期我们认为全量流式可以比较好的保留全部的输出信息(例如multi-step工具调用),您可以使用gui开启demo体验。终端输出这个我们评估下是否需要提供一个脚本转换输出格式

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants