You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[ X] I have checked the documentation and related resources and couldn't resolve my bug.
Describe the bug
Unable to pass an evaluation criteria to a SimpleCriteriaScore
Ragas version: 0.2.8
Python version: 3.12
Expected behavior
I want to set up my own simple validation in SimpleCriteriaScore but I am unable to, because in a code it is rewrited with some hardcoded validation criteria
self._definition = definition self.single_turn_prompt = single_turn_prompt or SingleTurnSimpleCriteriaPrompt() - i may pass my instruction here self.multi_turn_prompt = multi_turn_prompt or MultiTurnSimpleCriteriaPrompt() - i may pass my instruction here
update the instruction for the prompts with the definition
instruction = f"Evaluate the Input based on the criterial defined. Give a score between 0 and 5.\nCriteria Definition: {self._definition}"
self.single_turn_prompt.instruction = instruction
self.multi_turn_prompt.instruction = instruction
I also may pass my instruction in definition but it is also not working because of this instruction = f"Evaluate...
The text was updated successfully, but these errors were encountered:
[ X] I have checked the documentation and related resources and couldn't resolve my bug.
Describe the bug
Unable to pass an evaluation criteria to a SimpleCriteriaScore
Ragas version: 0.2.8
Python version: 3.12
Expected behavior
I want to set up my own simple validation in SimpleCriteriaScore but I am unable to, because in a code it is rewrited with some hardcoded validation criteria
self._definition = definition
self.single_turn_prompt = single_turn_prompt or SingleTurnSimpleCriteriaPrompt() - i may pass my instruction here
self.multi_turn_prompt = multi_turn_prompt or MultiTurnSimpleCriteriaPrompt() - i may pass my instruction here
update the instruction for the prompts with the definition
instruction = f"Evaluate the Input based on the criterial defined. Give a score between 0 and 5.\nCriteria Definition: {self._definition}"
self.single_turn_prompt.instruction = instruction
self.multi_turn_prompt.instruction = instruction
I also may pass my instruction in definition but it is also not working because of this instruction = f"Evaluate...
The text was updated successfully, but these errors were encountered: