Skip to content

v0.4.1 Support Append in Vector Search

Compare
Choose a tag to compare
@changhiskhan changhiskhan released this 05 Apr 21:30
· 1623 commits to main since this release

The vector search in Lance now supports live updates. Previously, when you added new vectors to the dataset, you would be required to rebuild the index. Now, the index is "inherited" and the vector search results are the combination of ANN search on the indexed data and KNN on the new Appended data. So there's a small latency increase and the recall should be the same or better.

This provides a smooth performance curve until you have inserted enough new data that re-indexing is warranted.

What's Changed

Full Changelog: v0.4.0...v0.4.1