Code

use fst for sstable index#2268

Code

Merged

trinity-1686a merged 19 commits intomainquickwit-oss/tantivy:mainfrom trinity--sstable-index-fstquickwit-oss/tantivy:trinity--sstable-index-fstCopy head branch name to clipboardDec 4, 2023

+1,086-323

Commits

Commits on Nov 14, 2023

• read path for new fst based index

  trinity-1686a

  committed
  97299b3

  Copy full SHA for 97299b3

Commits on Nov 15, 2023

• implement BlockAddrStoreWriter

  trinity-1686a

  committed
  fbecaba

  Copy full SHA for fbecaba

Commits on Nov 17, 2023

• new format with linear approx

  trinity-1686a

  committed
  50fe733

  Copy full SHA for 50fe733

Commits on Nov 20, 2023

• omit initial block range end save 8byte per 256 block

  trinity-1686a

  committed
  e6f1062

  Copy full SHA for e6f1062

• extract slop/derivation computation

  trinity-1686a

  committed
  b5c878a

  Copy full SHA for b5c878a

Commits on Nov 21, 2023

• use better linear approximator and allow negative correction to approximator

  trinity-1686a

  committed
  142cdeb

  Copy full SHA for 142cdeb

• document format and reorder some fields

  trinity-1686a

  committed
  bf07fed

  Copy full SHA for bf07fed

• optimize single block sstable size

  trinity-1686a

  committed
  2e4ff9e

  Copy full SHA for 2e4ff9e

• plug backward compat

  trinity-1686a

  committed
  fd441da

  Copy full SHA for fd441da

Commits on Nov 22, 2023

• remove debug prints

  trinity-1686a

  committed
  21181b4

  Copy full SHA for 21181b4

• handle errors and comment unwraps

  trinity-1686a

  committed
  b670a6e

  Copy full SHA for b670a6e

• Merge branch 'main' into trinity--sstable-index-fst

  trinity-1686a

  committed
  5ddca48

  Copy full SHA for 5ddca48

• fix sstable size in columnar tests

  trinity-1686a

  committed
  915d60b

  Copy full SHA for 915d60b

Commits on Nov 24, 2023

• typos

  trinity-1686a

  committed
  850944a

  Copy full SHA for 850944a

• document invariants arround find_best_slope

  trinity-1686a

  committed
  3a2f2f6

  Copy full SHA for 3a2f2f6

• use map.max instead of fold

  trinity-1686a

  committed
  1f4f895

  Copy full SHA for 1f4f895

• move sstable_index to versioned file name

  trinity-1686a

  committed
  fbecf03

  Copy full SHA for fbecf03

• remove byteorder dep

  trinity-1686a

  committed
  a036eb7

  Copy full SHA for a036eb7

Commits on Nov 30, 2023

• typo

  trinity-1686a

  committed
  0e2de87

  Copy full SHA for 0e2de87