Recommend new arxiv papers of your interest daily according to your Zotero libarary.

SGLang is a fast serving framework for large language models and vision language models.

Material for cuda-mode lectures

A high-throughput and memory-efficient inference and serving engine for LLMs

analyse problems of AI with Math and Code

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

CUDA by Example, written by two senior members of the CUDA software platform team, shows programmers how to employ this new technology. The authors introduce each area of CUDA development through w…

Samples for CUDA Developers which demonstrates features in CUDA Toolkit

📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥

⚡FlashRAG: A Python Toolkit for Efficient RAG Research

A curated list for Efficient Large Language Models

Knowhere is an open-source vector search engine, integrating FAISS, HNSW, etc.

A cloud-native vector database, storage for next generation AI applications

The course website for Large Language Models Methods and Applications

LLM training in simple, raw C/CUDA

Algorithms for approximate nearest neighbor search with window filters

Graph-structured Indices for Scalable, Fast, Fresh and Filtered Approximate Nearest Neighbor Search

C++ code examples for Modern C++ (32 chapters) in Geek Time

MiniOB is a compact database that assists developers in understanding the fundamental workings of a database.

A basic introduction to coding in modern C++.

Machine Learning Compilation Notebooks

System for AI Education Resource.

Artifacts for VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity