Skip to content
This repository has been archived by the owner on Nov 3, 2023. It is now read-only.

Update README.md for RAG #3873

Merged
merged 2 commits into from
Jul 28, 2021
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions parlai/agents/rag/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -155,6 +155,8 @@ python index_dense_embeddings.py --retriever-embedding-size 768 \
--embeddings-dir /tmp/wiki_passage_embeddings/ --embeddings-name wiki_passages
```

Note the default index factory setting is `IVF4096_HNSW128,PQ128`, if you are processing small files, you may encounter errors such as `Error: 'nx >= k' failed`, then you need to set `--compressed-indexer-factory` to other indexes in the [index factory in FAISS](https://github.com/facebookresearch/faiss/wiki/The-index-factory) such as `HNSW32`.

## Directory Structure / Custom Components

I will outline here the structure of the RAG directory, and where you might want to add custom components if you so desire.
Expand Down