New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Readme表格中记录的结果与opencompass outputs summary中结果的关系是什么？ #2

Open

imaginistLi opened this issue Aug 5, 2024 · 0 comments

imaginistLi commented Aug 5, 2024

Readme表格中记录的结果与opencompass summary中记录的结果的关系是什么？

我看opencompass中的结果是按照CIBench Generation、CIBench Template、CIBench Template Chinese来计算指标的，而你们的表格中直接给的是一个总的结果，这个总的结果和分开的几个类别的结果的关系是什么？是加权平均还是直接平均？

我自己跑的opencompass summary

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment