NUMA-aware KV cache buffer type (experimental)#11580

Draft

fairydreaming wants to merge 1 commit intoggml-org:masterfrom fairydreaming:numa-kv-buffer

+94-1

Commits on Feb 1, 2025

ggml : add NUMA-aware buffer type that allocates pages accordingly to the first-touch policy
sszymczy
committed