Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Folders can be learned with /learn multiple times #140

Open
3coins opened this issue May 3, 2023 · 4 comments
Open

Folders can be learned with /learn multiple times #140

3coins opened this issue May 3, 2023 · 4 comments
Assignees
Labels
bug Something isn't working @jupyter-ai/chatui

Comments

@3coins
Copy link
Collaborator

3coins commented May 3, 2023

Summary

If a directory has been already indexed with a previous /learn command, and is submitted for learning again, this proceeds without any warning. However, when the /ask command is used subsequently, the response contains all the extra context because of the duplicate document in the vector store.

Note: So, far only observed this issue with the anthropic:claude-v1.2 model. With openai:gpt-3.5-turbo, the LLM seems to work ok through the duplicate content.

@3coins 3coins added the bug Something isn't working label May 3, 2023
@JasonWeill
Copy link
Collaborator

Is this still an issue? Do any other models demonstrate it?

@JasonWeill JasonWeill added this to the 2.2.0 Release milestone Jul 28, 2023
@JasonWeill
Copy link
Collaborator

@3coins Please verify

@3coins
Copy link
Collaborator Author

3coins commented Aug 30, 2023

Could not replicate the issue with Anthropic claude-v1.2, but noticed that the /learn command is duplicating the data in the vector store.

Screenshot 2023-08-29 at 10 13 07 PM

@JasonWeill JasonWeill changed the title Submitting an existing indexed folder for /learn returns extra text Folders can be learned with /learn multiple times Oct 31, 2023
@JasonWeill
Copy link
Collaborator

I still see the behavior @3coins mentioned above. Not sure whether this is a bug we need to fix; although the UI looks unusual, it is normal to learn a folder more than once, since its contents may change.

@JasonWeill JasonWeill removed this from the 2.3.0 Release milestone Jan 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working @jupyter-ai/chatui
Projects
None yet
Development

No branches or pull requests

2 participants