Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] working directory issue? #107

Open
Dasol-Choi opened this issue Feb 20, 2025 · 1 comment
Open

[BUG] working directory issue? #107

Dasol-Choi opened this issue Feb 20, 2025 · 1 comment
Assignees
Labels
bug Something isn't working

Comments

@Dasol-Choi
Copy link
Member

(hr_eval) dasol@user-System-Product-Name:~/Dasol/haerae-evaluation-toolkit$ python llm_eval/evaluator.py
--model huggingface
--judge_model huggingface_judge
--reward_model huggingface_reward
--dataset haerae_bench
--subset csat_geo
--split test
--scaling_method beam_search
--evaluation_method string_match
--model_params '{"model_name_or_path": "gpt2"}'
--scaling_params '{"beam_size":3, "num_iterations":5}'
--output_file results.json
Traceback (most recent call last):
File "/home/dasol/Dasol/haerae-evaluation-toolkit/llm_eval/evaluator.py", line 6, in
from llm_eval.runner import PipelineRunner
ModuleNotFoundError: No module named 'llm_eval'

=> 레포 clone하고, 콘다 가상환경에 python 3.10 설치, requirements 설치하고 바로 돌려본건데 욜캐 뜨네요

Originally posted by @Dasol-Choi in #60

@Dasol-Choi Dasol-Choi added the bug Something isn't working label Feb 20, 2025
@h-albert-lee h-albert-lee self-assigned this Feb 25, 2025
@h-albert-lee
Copy link
Member

@Dasol-Choi 일단 wd문제는 맞는 것 같은데,이게 환경마다 다르게 나와서 확인이 어렵네요. 이슈 해결을 위해 bug report는 template 맞게 작성해주시고, 일단 실행 자체는 python -m llm_eval.evaluator 형태로 실행해보시는걸 권장드립니다!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: To triage
Development

No branches or pull requests

2 participants