Skip to content

Issues: explodinggradients/ragas

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

269 Open 623 Closed
269 Open 623 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Function is_base64 falsely classifies text as image bug Something isn't working
#1697 opened Nov 22, 2024 by VitahuHere
MultiHopAbstractQuerySynthesizer testset generation is not working. bug Something isn't working module-testsetgen Module testset generation
#1696 opened Nov 21, 2024 by kh-taher
Ragas with Llama-Index not working correctly due to misdefined scope bug Something isn't working module-testsetgen Module testset generation
#1695 opened Nov 21, 2024 by georgije-conv
TestsetGenerator() not producing the "response" field bug Something isn't working module-testsetgen Module testset generation
#1694 opened Nov 20, 2024 by rcruzgar
2
Prompt Error, TimeOut error bug Something isn't working
#1693 opened Nov 20, 2024 by giambascientist86
Exception raised in Job APIConnectionError(Connection error.) bug Something isn't working question Further information is requested
#1692 opened Nov 20, 2024 by ldzh-97
1
For some RAGAS metrics score is not accurate: module-metrics this is part of metrics module question Further information is requested
#1689 opened Nov 19, 2024 by Jahnavi-pothuri
1
AttributeError('StringIO' object has no attribute 'classifications') bug Something isn't working module-metrics this is part of metrics module
#1688 opened Nov 19, 2024 by timelesshc
AttributeError: object has no attribute 'sentences' bug Something isn't working question Further information is requested
#1683 opened Nov 17, 2024 by William8Work
Duplicate Questions and Spelling Mistakes in Generated Testset bug Something isn't working module-testsetgen Module testset generation question Further information is requested
#1682 opened Nov 15, 2024 by Jayashree-kalabhavi
1
Explicit the "Failed to parse output. Returning None." of RagasoutputParser or add a way to catch it. enhancement New feature or request
#1681 opened Nov 15, 2024 by Gwenn-LR
1
The example in ’https://docs.ragas.io/en/latest/getstarted/rag_testset_generation/‘ is not available bug Something isn't working module-testsetgen Module testset generation
#1677 opened Nov 14, 2024 by Createsnow
6
[R-314] Cost estimation for Transforms enhancement New feature or request
#1671 opened Nov 14, 2024 by jjmachan
Timeout Error bug Something isn't working question Further information is requested
#1667 opened Nov 13, 2024 by Dormiveglia-elf
3
Exceeding model token limit issues with open-source models locally hosted via vLLM bug Something isn't working
#1663 opened Nov 12, 2024 by YuffieHuang
Testset generation broken after migrating from 0.1.x to 0.2.4 bug Something isn't working module-testsetgen Module testset generation
#1660 opened Nov 12, 2024 by malikbrh
4
testset_generation：the max_wait not works bug Something isn't working module-testsetgen Module testset generation
#1659 opened Nov 12, 2024 by jackqdldd
2
Issue about tool call metrics. module-metrics this is part of metrics module question Further information is requested
#1658 opened Nov 12, 2024 by MattZ-99
1
2
testset-generation: Embedding issues in apply_transforms bug Something isn't working module-testsetgen Module testset generation
#1657 opened Nov 12, 2024 by shashi792
1
Can I control the concurrency of calling LLM bug Something isn't working question Further information is requested
#1654 opened Nov 11, 2024 by jackqdldd
1
WARNING:ragas.metrics._faithfulness:No statements were generated from the answer. bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#1651 opened Nov 9, 2024 by kyuz0
2
FaithfulnesswithHHEM doesn't match original prompt, leading to inconsistent scores bug Something isn't working module-metrics this is part of metrics module
#1648 opened Nov 9, 2024 by AshishSardana
Seed questions for guiding test generation module-testsetgen Module testset generation question Further information is requested
#1642 opened Nov 7, 2024 by ableiweiss
2
Issue with SSL certificate verification bug Something isn't working
#1637 opened Nov 6, 2024 by AkileshSivaswamy
6
Subject: Issue with Agentic AI Metrics (Topic Adherence and Agent Goal Accuracy) bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#1633 opened Nov 6, 2024 by Nari995
8
ProTip! Exclude everything labeled bug with -label:bug.