Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add the option to mark both as correct in A\B testing human evaluation #1195

Closed
aakrem opened this issue Jan 14, 2024 · 0 comments · Fixed by #1231
Closed

Add the option to mark both as correct in A\B testing human evaluation #1195

aakrem opened this issue Jan 14, 2024 · 0 comments · Fixed by #1231
Assignees
@bekossy
Labels
Backend Frontend

Comments

@aakrem
Copy link
Collaborator

aakrem commented Jan 14, 2024 •
edited by mmabrouk
Loading

In A/B Testing in human evaluation we only have 3 options
A - B - Both are bad.
We want to have a 4th one which is both are good.

(Let's implement this from the evaluations-in-backend branch)
@bekossy bekossy mentioned this issue Jan 17, 2024
Closed
@bekossy bekossy linked a pull request Jan 18, 2024 that will close this issue
Add the option to mark both as correct in A\B testing human evaluation #1216
Closed
@bekossy bekossy removed a link to a pull request Jan 18, 2024
Add the option to mark both as correct in A\B testing human evaluation #1216
Closed
@bekossy bekossy mentioned this issue Jan 18, 2024
Merged
@bekossy bekossy linked a pull request Jan 19, 2024 that will close this issue
Add the option to mark both as correct in A\B testing human evaluation #1231
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@bekossy bekossy

Labels
Backend Frontend
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add the option to mark both as correct in A\B testing human evaluation Agenta-AI/agenta
2 participants
@aakrem @bekossy