Code

Streaming PQ#689

Code

Merged

eddyxu merged 24 commits intomainlancedb/lance:mainfrom lei/stream_pqlancedb/lance:lei/stream_pqCopy head branch name to clipboardMar 17, 2023

+737-493

Commits

Commits on Mar 16, 2023

• set opq in proto

  Show description for 4c97641
  eddyxu

  committed
  4c97641

  Copy full SHA for 4c97641

• fix size list to matrix

  eddyxu

  committed
  4525466

  Copy full SHA for 4525466

• train ivf

  eddyxu

  committed
  2029a23

  Copy full SHA for 2029a23

• extract out residual compute

  eddyxu

  committed
  6b3646f

  Copy full SHA for 6b3646f

• only train pq

  eddyxu

  committed
  762d8bd

  Copy full SHA for 762d8bd

• extract pq train

  eddyxu

  committed
  2973fd2

  Copy full SHA for 2973fd2

• add

  eddyxu

  committed
  96baecb

  Copy full SHA for 96baecb

• make ProductQuantizer::fit_transform work with MatrixView (#677)

  Show description for 03794f6
  

  changhiskhan

  authored and

  eddyxu

  committed
  03794f6

  Copy full SHA for 03794f6

• pass all tests

  eddyxu

  committed
  4cc82eb

  Copy full SHA for 4cc82eb

• persistent opq as a transform

  eddyxu

  committed
  307d781

  Copy full SHA for 307d781

• serialize transform

  eddyxu

  committed
  b249b1a

  Copy full SHA for b249b1a

• write

  eddyxu

  committed
  3d9d8db

  Copy full SHA for 3d9d8db

• load opq

  eddyxu

  committed
  f231306

  Copy full SHA for f231306

• load pq

  eddyxu

  committed
  c5a47bf

  Copy full SHA for c5a47bf

• read

  eddyxu

  committed
  9fe206a

  Copy full SHA for 9fe206a

• remove opq related code

  eddyxu

  committed
  a500810

  Copy full SHA for a500810

• remove opq training

  eddyxu

  committed
  503265f

  Copy full SHA for 503265f

• fix cargo fmt

  eddyxu

  committed
  9a9225c

  Copy full SHA for 9a9225c

• Merge branch 'main' into lei/stream_pq

  eddyxu

  authored
  f364ee8

  Copy full SHA for f364ee8

• check

  eddyxu

  committed
  3ecd78d

  Copy full SHA for 3ecd78d

• Merge branch 'main' into lei/stream_pq

  eddyxu

  authored
  e4a5b12

  Copy full SHA for e4a5b12

Commits on Mar 17, 2023

• pass max iteration and update sift stats

  eddyxu

  committed
  8c6c7ad

  Copy full SHA for 8c6c7ad

• cargo fmt

  eddyxu

  committed
  3db88c4

  Copy full SHA for 3db88c4

• fix build

  eddyxu

  committed
  6a08edc

  Copy full SHA for 6a08edc