v0.6.1: Datafusion 28, Persist Schema Metadata, Dataset::add API improvements

What's Changed

• Implement L2/norm/cosine/dot for bf16/f16/f64 by @eddyxu in #1121
• fix: cast when passed an iterator by @wjones127 in #1123
• feat: detect commit conflicts by @wjones127 in #1104
• feat: upgrade to datafusion 28.0.0 and arrow 43.0 by @westonpace in #1125
• feat: upgrade arrow to 43.0 in duckdb-lance by @westonpace in #1126
• feat: switch session caches to use moka cache instead of LruCache by @westonpace in #1131
• Added append method for dataset which takes self as arguemnt with tests by @trueutkarsh in #1122
• feat: Persist schema metadata by @gsilvestrin in #1133

New Contributors

• @westonpace made their first contribution in #1125

Full Changelog: v0.6.0...v0.6.1

v0.6.0: Rename score column and bug fixes for deletions

⚠️ Breaking Change: The score column has been renamed to _distance to more accurately describe the semantics (smaller means closer / better).

What's Changed

• Rename "score" to "_distance" by @trueutkarsh in #1055
• fix: take and search now work properly with deletions by @wjones127 in #1113
• Improve grammar of README by @michaelmior in #1101
• Serde Fragment to json by @eddyxu in #1105
• ci: fix the release commit script by @wjones127 in #1119

New Contributors

• @michaelmior made their first contribution in #1101

Full Changelog: v0.5.10...v0.6.0

v0.5.10: tf.data integration, Pandas as optional dependency, Bug Fixes

What's Changed

• feat: make pandas optional dependency by @rok in #1084
• fix bug in pandas check by @changhiskhan in #1085
• [Python] Set batch_size in Dataset::scanner() by @eddyxu in #1088
• [Python] Scanner dataset and projection schema by @eddyxu in #1089
• docs: add clarifications to format about fields by @wjones127 in #1052
• feat: add additional caching and expose batch size by @wjones127 in #1082
• feat: enforce max rows per group and file by @wjones127 in #1093
• [WIP] Tf.data pipeline by @eddyxu in #1087
• feat: track the max used fragment id by @wjones127 in #1092
• [Doc] Use Lance with tf.data by @eddyxu in #1096

New Contributors

• @rok made their first contribution in #1084

Full Changelog: v0.5.9...v0.5.10

v0.5.9: minor fix for S3 to support minio

What's Changed

• feat: pass through aws environment vars by @wjones127 in #1077

Full Changelog: v0.5.8...v0.5.9

v0.5.8 Bug fix and document improvement

What's Changed

• [Python] Remove OPQ cargo feature by @gsilvestrin in #1069
• [Rust] Expose JsonSchema struct as public struct by @eddyxu in #1070
• [Rust] Provide schema conv for both schema and reference by @eddyxu in #1071
• [Rust] fix: make sure we can append with dictionary columns by @wjones127 in #1053
• [Docs]: reduce docs warnings by @wjones127 in #1068

Full Changelog: v0.5.7...v0.5.8

v0.5.7 Initial Bfloat16 support

Highlight

• Lance adds initial bfloat16 support for Machine Learning workloads!

https://lancedb.github.io/lance/arrays.html

What's Changed

• fix: make write_impl private by @wjones127 in #1061
• [Rust] Convert between json / arrow schema by @eddyxu in #1064
• [Python] Expose schema and json conversion via Python SDK by @eddyxu in #1067
• Add bfloat16 extension array by @wjones127 in #1002

Full Changelog: v0.5.6...v0.5.7

v0.5.6: Improved Windows build process, fix warnings and docs

What's Changed

• [Doc, Rust] Improve docstring about how to use Dataset write in Rust by @eddyxu in #1060
• [Rust] Fix new warnings on rust 1.71 by @eddyxu in #1063
• windows: make openblas optional and remove vcpkg by @gsilvestrin in #1062
• pin half by @wjones127 in #1065
• Removed duplicated dependency by @gsilvestrin in #1066

Full Changelog: v0.5.5...v0.5.6

v0.5.5: Fix ARM wheel build, allow custom AWS credentials when writing dataset

What's Changed

• allow aws cred injection in dataset write as well by @chebbyChefNEQ in #1059
• Arm quick fix by @unkn-wn in #1057

Full Changelog: v0.5.4...v0.5.5

v0.5.4: Contribution guide, ARM Linux build, and other improvments

What's Changed

• feat: upgrade arrow, make write Send by @wjones127 in #1033
• Bring commented out clippy rule back after GHA rust upgrade by @eddyxu in #1039
• contributing guide by @changhiskhan in #1036
• use a large runner for linux tests by @changhiskhan in #1038
• bugfix: remove extra character from jq filter in GHA by @gsilvestrin in #941
• upgrade arrow version in duckdb extension by @changhiskhan in #1040
• Docs: Dataset write takes reader by owner now by @dnsco in #1042
• allow custom AWS credentials when constructing object store by @chebbyChefNEQ in #1049
• fix: don't compare metadata when checking schema in append by @wjones127 in #1051
• Add support for ARM architecture by @unkn-wn in #1043

New Contributors

• @unkn-wn made their first contribution in #1043

Full Changelog: v0.5.3...v0.5.4

v0.5.3 Create empty table, Support writing iterator of RecordBatch

What's Changed

• [rust] Added support for creating empty dataset by @trueutkarsh in #1016
• [Rust] Use unaligned load in cosine on Intel CPUs by @eddyxu in #1035
• cache aws credentials until 30s before expiry by @chebbyChefNEQ in #1034
• fix record batch writing to dataset by @TevinWang in #1030
• docs: update format docs with feature flags and row indices by @wjones127 in #1037

Full Changelog: v0.5.2...v0.5.3