[BUG] <title> assert "factor" in rope_scaling使用VLLM部署Qwen2-VL-7B，有遇到这个报错的吗？

[whitesay]

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

• 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

• 我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

File "/home/hibug/anaconda3/envs/mllm/lib/python3.10/site-packages/vllm/entrypoints/openai/api_server.py", line 132, in build_async_engine_client_from_engine_args
if (model_is_embedding(engine_args.model, engine_args.trust_remote_code,
File "/home/hibug/anaconda3/envs/mllm/lib/python3.10/site-packages/vllm/entrypoints/openai/api_server.py", line 73, in model_is_embedding
return ModelConfig(model=model_name,
File "/home/hibug/anaconda3/envs/mllm/lib/python3.10/site-packages/vllm/config.py", line 227, in init
self.max_model_len = _get_and_verify_max_len(
File "/home/hibug/anaconda3/envs/mllm/lib/python3.10/site-packages/vllm/config.py", line 1747, in _get_and_verify_max_len
assert "factor" in rope_scaling
AssertionError

期望行为 | Expected Behavior

No response

复现方法 | Steps To Reproduce

No response

运行环境 | Environment

- OS:
- Python:
- Transformers:
- PyTorch:
- CUDA (`python -c 'import torch; print(torch.version.cuda)'`):

备注 | Anything else?

No response

[Zara7hus7ra]

same problem

[whitesay]

已收到您的信件！

[Zara7hus7ra]

same problem
Solved using the temp fix in
QwenLM/Qwen2-VL#96 (comment)