Skip to content

[Core] Use flashinfer sampling kernel when available#7137

Merged
comaniac merged 27 commits intovllm-project:mainfrom peng1999:opt-topkAug 19, 2024

Commits

Commits on Aug 5, 2024

Commits on Aug 6, 2024

Commits on Aug 7, 2024

Commits on Aug 8, 2024

Commits on Aug 12, 2024

Commits on Aug 16, 2024

Commits on Aug 17, 2024

Commits on Aug 19, 2024