Skip to content

Issues: huggingface/evaluate

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

158 Open 141 Closed
158 Open 141 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Evaluation took so much disk
#649 opened Nov 21, 2024 by uluumbch
evaluate.load() does not work while loading word_count
#648 opened Nov 15, 2024 by sindhu-pr
TypeError: 'NoneType' object is not callable
#647 opened Oct 30, 2024 by Yichangfa
1
FileNotFoundError: Couldn't find a module script at /mnt/data/dingtian/exact_match/exact_match.py. Module 'exact_match' doesn't exist on the Hugging Face Hub either.
#645 opened Oct 21, 2024 by Tiannn0703
[FR] Binoculars as a new metric
#644 opened Oct 20, 2024 by MayankChaturvedi
Perplexity for quantized models
#643 opened Oct 17, 2024 by Hongao0611
1
ImportError: To be able to use evaluate-metric/glue, you need to install the following dependencies['scipy', 'scikit-learn'] using 'pip install scipy sklearn' for instance'
#642 opened Sep 24, 2024 by JINO-ROHIT
3
Optionally stop data deletion after compute
#641 opened Sep 24, 2024 by sizhky
Typo in Types of Evaluations in 🤗 Evaluate documentation
#639 opened Sep 18, 2024 by sergiopaniego
1
Perplexity for Left Padded Models
#636 opened Sep 15, 2024 by Lawhy
CI parity test is broken due to FileNotFoundError
#632 opened Sep 12, 2024 by albertvillanova
1
@albertvillanova
list_evaluation_modules returns empty list
#616 opened Aug 23, 2024 by MohamedAliRashad
2
Benchmark evaluation for language models.
#615 opened Aug 19, 2024 by mina58
1
Unable to compute f1 score - Throwing Value Error trying to convert a string in non english Language to integer
#610 opened Aug 1, 2024 by alans3321
AttributeError: module 'evaluate' has no attribute 'load'
#609 opened Jul 31, 2024 by Adesoji1
7
[Metrics] ValueError: Expected to find locked file from process x but it doesn't exist.
#607 opened Jul 11, 2024 by raghavm1
1
AttributeError: 'CombinedEvaluations' object has no attribute 'evaluation_modules'
#603 opened Jun 23, 2024 by shunk031
1
2
Gradio dependency issue
#602 opened Jun 21, 2024 by bnaman50
2
Evaluation of form feed symbol with BLEU results in error
#601 opened Jun 11, 2024 by lowlypalace
LocalModuleTest.test_load_metric_code_eval fails with "The "code_eval" metric executes untrusted model-generated code in Python."
#597 opened Jun 8, 2024 by jpodivin
Execution of example from the Using the evaluator docs fails due to unspecified tokenizer
#594 opened Jun 2, 2024 by jpodivin
1
Evaluation of empty strings with MAUVE results in error
#593 opened May 24, 2024 by lowlypalace
SyntaxError: closing parenthesis '}'
#592 opened May 12, 2024 by wangxiuwen
3
Problems during run initial step
#590 opened May 7, 2024 by simplelifetime
12
Can't load exist dataset for evaluation
#589 opened May 6, 2024 by IsmaelMousa
1
ProTip! Find all open issues with in progress development work with linked:pr.