Skip to content

Issues: explodinggradients/ragas

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

287 Open 638 Closed
287 Open 638 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Version file not found bug Something isn't working
#1761 opened Dec 13, 2024 by ejoly3
Incorrect evaluation results using EvaluatorChain integration bug Something isn't working
#1760 opened Dec 13, 2024 by wriazati
SimpleCriteriaScore not processing reference at all (how it is presented in Simple Criteria Scoring examples) bug Something isn't working module-metrics this is part of metrics module
#1757 opened Dec 13, 2024 by vklonin
1
Generate score explanation during evaluation question Further information is requested
#1752 opened Dec 12, 2024 by Sergio-Zavota
1
ValueError: Argument 'prompts' is expected to be of type List[str] bug Something isn't working
#1749 opened Dec 10, 2024 by sairampillai
@jjmachan
Example code in documentation not working after latest release - Faithfulness bug Something isn't working
#1748 opened Dec 10, 2024 by sairampillai
V0.2.7 Context Recall only returning 1 or 0 values bug Something isn't working question Further information is requested
#1745 opened Dec 10, 2024 by timelesshc
LangchainLLMWrapper not compatible with some BaseLanguageModel implementations (ChatOllama) bug Something isn't working
#1737 opened Dec 6, 2024 by jolyons123
2
Relying on pySBD is not feasible- package hasn't been updated in 3 years (sentence segmentation) enhancement New feature or request
#1736 opened Dec 6, 2024 by diegodebrito
1
Error while generating synthetic testset bug Something isn't working module-testsetgen Module testset generation question Further information is requested
#1735 opened Dec 6, 2024 by shoxyouness
1
Test Set Generation Failure bug Something isn't working module-testsetgen Module testset generation question Further information is requested
#1731 opened Dec 4, 2024 by abivarshinit-intechive
1
Duplicated document node generated during knowlege graph creation bug Something isn't working
#1730 opened Dec 4, 2024 by xizhou-vw
How to write custom prompt for faithfullness with PydanticPrompt question Further information is requested
#1729 opened Dec 4, 2024 by pratikchhapolika
1
No module named 'ragas.llms.prompt' to create custom Prompt for any metrics bug Something isn't working
#1726 opened Dec 4, 2024 by pratikchhapolika
Using another way to pass the OPENAI_API_KEY aside from the environment variable bug Something isn't working
#1725 opened Dec 4, 2024 by Icemap
1 task done
I want to use Huggingface model for test data generation, but getting error: ERROR:ragas.testset.transforms.engine:unable to apply transformation: Node 3da710f8-fc20-40ef-97bf-7f11fb7be538 has no summary_embedding bug Something isn't working enhancement New feature or request module-testsetgen Module testset generation
#1720 opened Dec 2, 2024 by wanjeakshay
AnswerRelevancy errored with OpenAI key when it is set to use different LLM bug Something isn't working
#1719 opened Dec 2, 2024 by WillMusing
1
Same metrics function with different content must be rewrite the function ?? bug Something isn't working module-metrics this is part of metrics module
#1715 opened Nov 28, 2024 by YYH211
1
Evaluate graph RAG LLM application question Further information is requested
#1713 opened Nov 27, 2024 by Howie-Arup
Error in determining costs using token_usage_parser and unintentional usage of GPT-3.5 Turbo bug Something isn't working module-testsetgen Module testset generation
#1712 opened Nov 26, 2024 by VyoJ
_reproducibility in faithfulness not being used bug Something isn't working
#1711 opened Nov 26, 2024 by Kefan-pauline
Index Error when trying to evaluate() a simple example bug Something isn't working question Further information is requested
#1710 opened Nov 26, 2024 by taledv
Issue with running code snippet in docs to create custom metrics bug Something isn't working
#1709 opened Nov 26, 2024 by sriyanope
Is there a way to get only one Output result using RAGAS 0.2.6 question Further information is requested
#1704 opened Nov 26, 2024 by taeil00
LLMContextPrecisionWithoutReference is only producing 0.0 as the score bug Something isn't working
#1703 opened Nov 25, 2024 by nbarnett19
ProTip! Follow long discussions with comments:>50.