Skip to content

@kvcache-ai kvcache.ai

Change the repository type filter

All

    Repositories list

    5 repositories

    • ktransformers

      Public
      A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
      Python
      •
      Apache License 2.0
      •53•902•24•1•Updated Feb 10, 2025Feb 10, 2025

    • custom_flashinfer

      Public
      FlashInfer: Kernel Library for LLM Serving
      Cuda
      •
      Apache License 2.0
      •198•0•0•0•Updated Feb 10, 2025Feb 10, 2025

    • Mooncake

      Public
      Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
      C++
      •
      Apache License 2.0
      •147•2.5k•20•3•Updated Feb 8, 2025Feb 8, 2025

    • ktransformers-private

      Public
      A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
      Python
      •
      Apache License 2.0
      •53•0•0•0•Updated Feb 8, 2025Feb 8, 2025

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •5.6k•8•0•0•Updated Feb 7, 2025Feb 7, 2025