[KVCache] Add max num threads awareness to KVCache kernels#1822

Merged

tqchen merged 5 commits intomlc-ai:mainfrom CharlieFRuan:pr-0223-kernel-threads

Feb 28, 2024

+199-83

Commits on Feb 23, 2024

[KVCache] Add max num threads to KVCache kernels, fix WebGPU
CharlieFRuan
committed

Commits on Feb 27, 2024

Read max_num_threads_per_block when available
CharlieFRuan
committed

Commits on Feb 28, 2024