Skip to content

fix: resolve the fp8 bug introduced by vLLM 0.5.5#1276

Merged
zhyncs merged 1 commit intomainfrom fix-deepseek-v2-fp8Aug 31, 2024

Commits

Commits on Aug 31, 2024