huggingface openLLM 跑分和 opencompass 的跑分不一致的原因是什么? #349
amulil
started this conversation in
View all discussions
Replies: 1 comment
-
Hi, the difference may be due to different prompts. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
比如:
meta-llama/llama2-7b-chat-hf 的 mmlu 跑分
opencompass 结果是 46.2
huggingface openLLM 结果是 48.32
一样的模型,一样的数据集,造成这种差距的原因是什么
Beta Was this translation helpful? Give feedback.
All reactions