Major Changes
- January 2025 Update by @m0nsky, @Lyrcaxis, @SignalRT & @martindevans in #1036
- Removed .NET6 by @martindevans in #982
- Implemented
LogitBias
forDefaultSamplingPipeline
by @martindevans in #986
Bug Fixes
- Fixed
LLamaTokenDataArrayNative.Create
's size initialization by @Lyrcaxis in #981 - Fixed
ChatSession.LoadSession
by @martindevans in #976 - Non-deterministic default seed by @Lyrcaxis in #993
- Fixed log levels (issue #995) by @LoicDagnas in #997
- Fix Batching shared token issues by @martindevans in #1045
Other Changes
- Adding simple batch example by @phil-scott-78 in #1038
- Add an option to apply the chat template to prompts when using StateslessExecutor by @phil-scott-78 in #1025
- Adds an exception for missing templates. by @phil-scott-78 in #1034
- Updated tests model to "LLama 3.2 1B Instruct" by @Lyrcaxis in #983
- Update M.E.AI.Abstractions by @stephentoub in #979, #992 and #1044
- Added sampling tests by @Lyrcaxis in #984
- Updated Nuget Dependencies by @martindevans in #987
- Helper method for sampling
Conversation
withSafeLLamaSamplerChainHandle
by @martindevans in #994
New Contributors
- @LoicDagnas made their first contribution in #997
- @AcoranGonzalezMoray made their first contribution in #1015
- @phil-scott-78 made their first contribution in #1025
Full Changelog: v0.19.0...v0.20.0