Releases: SciSharp/LLamaSharp
Releases · SciSharp/LLamaSharp
v0.2.3 - Inference BUG Fix
Fix some strange behaviors of model inference.
v0.2.2 - Embedder
- Sync with the latest llama.cpp master branch.
- Add
LLamaEmbedder
to support to get the embeddings only. - Add
n_gpu_layers
andprompt_cache_all
param. - Split the package into main package + backend package.
v0.2.1 - Chat session, quantization and Web API
- Add basic APIs and chat session.
- Support quantization.
- Add Web API support.