v0.7.2 Revert back to manylinux2014

What's Changed

• Revert "upgrade manylinux to 2_28 (#1234)" by @chebbyChefNEQ in #1244

Full Changelog: v0.7.1...v0.7.2

v0.7.1 Experimental S3 concurrent writer support, performance improvements and bugfixes, and more

What's Changed

• fix rust ci by @wjones127 in #1197
• feat: add count_rows to scanner by @westonpace in #1150
• move manifest path logic into commit handler by @chebbyChefNEQ in #1198
• implement ExternalManifestCommitHandler and trait ExternalManifestStore by @chebbyChefNEQ in #1190
• fix window test and sleep longer on asof test by @chebbyChefNEQ in #1204
• refactor: allow creating empty dataset fragments by @rok in #1229
• add documentation for external store commit procedure by @chebbyChefNEQ in #1207
• Implement path finalization for external manifest store by @chebbyChefNEQ in #1233
• implement dynamodb external manifest store by @chebbyChefNEQ in #1205
• upgrade manylinux to 2_28 by @eddyxu in #1234
• fix clippy on main by @chebbyChefNEQ in #1236
• perf: reduce copies and skip zeroing memory we read into by @wjones127 in #1238
• add parsing in object store for s3+ddb scheme by @chebbyChefNEQ in #1239
• add documentation for dynamodb uri by @chebbyChefNEQ in #1242
• fix images references in documents by @chebbyChefNEQ in #1243
• feat: add a fast path for pq index if there are no missing fragments/rows by @westonpace in #1240

Full Changelog: v0.7.0...v0.7.1

v0.7.0 Index statistics, TFRecord reader, improved tf.data reader

What's Changed

• [Doc] Add deep dive presentation to README by @eddyxu in #1167
• run format and clippy on latest rust by @wjones127 in #1171
• feat: expose index stats for debugging by @rok in #1097
• feat: add cleanup_old_versions method which will remove unreferenced old files by @westonpace in #1140
• [bench] Fix up rust benchmarks by @changhiskhan in #1176
• feat: add a background executor for Python by @wjones127 in #1172
• [python] Validate schema metadata by @changhiskhan in #1186
• use commit handler to find the latest version of a dataset by @chebbyChefNEQ in #1187
• Remove request dependency as it's only used for its re-export of http by @dnsco in #1189
• feat: add support for field metdata by @westonpace in #1173
• feat: parse TFRecords as Arrow data by @wjones127 in #1166
• feat: add function to cleanup partial writes by @wjones127 in #1182
• feat: tf.data support for binary, struct, and FixedShapeTensor by @wjones127 in #1191
• fix: make field name consistent by @wjones127 in #1192
• refactor: pass params by reference in from_uri_and_params method by @westonpace in #1194

Full Changelog: v0.6.5...v0.7.0

v0.6.5 Fix dot distance

What's Changed

• [Rust] Compute dot distance as negative dot product by @eddyxu in #1160
• fix: Scanner schema fix by @gsilvestrin in #1161
• implement flat vector index benchmark by @chebbyChefNEQ in #1163
• clean cached wheels by @wjones127 in #1159

Full Changelog: v0.6.4...v0.6.5

v0.6.4 Commit improvement, Distributed progress tracker for fragment writer

What's Changed

• feat: rebase restore feature on top of transactions feature by @westonpace in #1143
• feat: pass commit handler on dataset load by @wjones127 in #1154
• Track writing fragment progress by @eddyxu in #1146

Full Changelog: v0.6.3...v0.6.4

v0.6.3 Concurrent Transactions and Minor Fixes

What's Changed

• fix rust build error on Mac and remove warning messages from running benchmark by @QianZhu in #1137
• feat: transaction files and commit conflict resolution by @wjones127 in #1127
• [Rust] Benchmark for dot product by @eddyxu in #1142
• feat: quick restore command by @wjones127 in #1138
• Revert "feat: quick restore command (#1138)" by @eddyxu in #1148
• Fragment::write honors row group size by @eddyxu in #1145
• expose aws region configurability by @chebbyChefNEQ in #1153
• fix docs build by @changhiskhan in #1156

New Contributors

• @QianZhu made their first contribution in #1137

Full Changelog: v0.6.2...v0.6.3

v0.6.2 aws credential bug fix

What's Changed

• propagate credential when opening dataset for write by @chebbyChefNEQ in #1136

Full Changelog: v0.6.1...v0.6.2

v0.6.1: Datafusion 28, Persist Schema Metadata, Dataset::add API improvements

What's Changed

• Implement L2/norm/cosine/dot for bf16/f16/f64 by @eddyxu in #1121
• fix: cast when passed an iterator by @wjones127 in #1123
• feat: detect commit conflicts by @wjones127 in #1104
• feat: upgrade to datafusion 28.0.0 and arrow 43.0 by @westonpace in #1125
• feat: upgrade arrow to 43.0 in duckdb-lance by @westonpace in #1126
• feat: switch session caches to use moka cache instead of LruCache by @westonpace in #1131
• Added append method for dataset which takes self as arguemnt with tests by @trueutkarsh in #1122
• feat: Persist schema metadata by @gsilvestrin in #1133

New Contributors

• @westonpace made their first contribution in #1125

Full Changelog: v0.6.0...v0.6.1

v0.6.0: Rename score column and bug fixes for deletions

⚠️ Breaking Change: The score column has been renamed to _distance to more accurately describe the semantics (smaller means closer / better).

What's Changed

• Rename "score" to "_distance" by @trueutkarsh in #1055
• fix: take and search now work properly with deletions by @wjones127 in #1113
• Improve grammar of README by @michaelmior in #1101
• Serde Fragment to json by @eddyxu in #1105
• ci: fix the release commit script by @wjones127 in #1119

New Contributors

• @michaelmior made their first contribution in #1101

Full Changelog: v0.5.10...v0.6.0

v0.5.10: tf.data integration, Pandas as optional dependency, Bug Fixes

What's Changed

• feat: make pandas optional dependency by @rok in #1084
• fix bug in pandas check by @changhiskhan in #1085
• [Python] Set batch_size in Dataset::scanner() by @eddyxu in #1088
• [Python] Scanner dataset and projection schema by @eddyxu in #1089
• docs: add clarifications to format about fields by @wjones127 in #1052
• feat: add additional caching and expose batch size by @wjones127 in #1082
• feat: enforce max rows per group and file by @wjones127 in #1093
• [WIP] Tf.data pipeline by @eddyxu in #1087
• feat: track the max used fragment id by @wjones127 in #1092
• [Doc] Use Lance with tf.data by @eddyxu in #1096

New Contributors

• @rok made their first contribution in #1084

Full Changelog: v0.5.9...v0.5.10