Test to measure cuda vs non-cuda decode.#5575

Draft

sroy745 wants to merge 8 commits intovllm-project:mainfrom sroy745:sd-enable-bonus-token

+105-9

Commits on May 29, 2024

Merge pull request #1 from vllm-project/main
sroy745
authored

Commits on Jun 3, 2024

Commits on Jun 7, 2024

Merge branch 'vllm-project:main' into main
sroy745
authored

Commits on Jun 10, 2024

Merge branch 'vllm-project:main' into main
sroy745
authored

Commits on Jun 12, 2024

Merge branch 'vllm-project:main' into main
sroy745
authored

Commits on Jun 14, 2024

Merge branch 'vllm-project:main' into main
sroy745
authored

Commits on Jun 16, 2024

Test to measure cuda vs non cuda decode
sroy745
committed