Code

Attention sparse embeddings#235

Code

Merged

joein merged 9 commits intomainqdrant/fastembed:mainfrom attention-sparse-embeddingsqdrant/fastembed:attention-sparse-embeddingsCopy head branch name to clipboardMay 24, 2024

+486-66

Commits

Commits on May 22, 2024

• WIP: sparse embeddings using attention

  generall

  committed
  e3eecac

  Copy full SHA for e3eecac

• support for stopwords

  generall

  committed
  b9a9820

  Copy full SHA for b9a9820

• apply stopwords

  generall

  committed
  8427276

  Copy full SHA for 8427276

• proceed implementation of sparse attention embeddings (#234)

  

  joein

  authored and

  generall

  committed
  a4bb5a3

  Copy full SHA for a4bb5a3

• complete inference

  generall

  committed
  81f5567

  Copy full SHA for 81f5567

• query embed + comment

  generall

  committed
  65252ab

  Copy full SHA for 65252ab

• use simpler weights formula instead of sorting of words

  generall

  committed
  223352e

  Copy full SHA for 223352e

• update tests

  generall

  committed
  6e5eafc

  Copy full SHA for 6e5eafc

• fix: fix bm42 usage, add query_embed to SparseTextEmbedding, update tests

  

  joein

  authored and

  generall

  committed
  ad80e59

  Copy full SHA for ad80e59