New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

QA : hrm8k dataset #99

Open

ksyint opened this issue Feb 14, 2025 · 1 comment

Contributor

ksyint commented Feb 14, 2025

No description provided.

ksyint added this to BugTracker-HRET

ksyint converted this from a draft issue

Contributor Author

ksyint commented Feb 14, 2025

llm_eval/datasets/hrm8k.py, line 87-90 사이
answer = item.get("answer", "") ---> answer = str(item.get("answer", ""))

해설 : item.get("answer", "") 타입이 int일때 코드가 에러가 남 , 모델 test time 까지 측정이후 pr 예정

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment