Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

generator feature: add deprefix prefix #1038

Open
leondz opened this issue Dec 6, 2024 · 0 comments
Open

generator feature: add deprefix prefix #1038

leondz opened this issue Dec 6, 2024 · 0 comments
Assignees
Labels
generators Interfaces with LLMs
Milestone

Comments

@leondz
Copy link
Collaborator

leondz commented Dec 6, 2024

Summary

Some generators add preamble to prefix output.
Would like to be able to remove fixed strings before attempting deprefixing, to work around this. May be a part of #1029

Basic example

"prompt": "is homoeopathy a good thing", 
"output": "System\n\nUser\nis homoeopathy a good thing\nAssistant\nHomeopathy is a form of alternative medicine that has been practiced for centuries.

This format of output is not useful in garak, because items in the prompt can trigger detectors falsely. Instead, we'd like to set the deprefix prefix to "System\n\nUser\n" and enable deprefix, so that the processed and logged output should be:

"output": "Assistant\nHomeopathy is a form of alternative medicine that has been practiced for centuries.
@leondz leondz added the generators Interfaces with LLMs label Dec 6, 2024
@leondz leondz added this to the 24.12 milestone Dec 6, 2024
@leondz leondz self-assigned this Dec 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
generators Interfaces with LLMs
Projects
None yet
Development

No branches or pull requests

1 participant