Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

new IndexWriter for any block #143

Closed
3 tasks done
Tracked by #139
gmaclennan opened this issue Aug 4, 2023 · 1 comment
Closed
3 tasks done
Tracked by #139

new IndexWriter for any block #143

gmaclennan opened this issue Aug 4, 2023 · 1 comment
Assignees

Comments

@gmaclennan
Copy link
Member

gmaclennan commented Aug 4, 2023

IndexWriter

One instance that does all writing to the indexes. Only place where SQLite is written to (all other places are read-only SQLite). Just exports one method batch() which writes one or more blocks to the index.

  • Decodes blocks from buffers
  • Ignores invalid blocks
  • Migrates previous schema versions if required
  • Writes each data type to a separate sqlite table
  • batch() resolves when documents are written to the index
  • If batch errors, should return details about any docs that were written
const indexer = new Indexer({
  schemaNames: [] // Array of schema names to process
})
indexer.batch(blocks: Buffer[]): Promise<void>

Depends on:

@gmaclennan gmaclennan changed the title new IndexWriter (run on separate thread) new IndexWriter for any block Aug 4, 2023
@gmaclennan gmaclennan self-assigned this Aug 4, 2023
@gmaclennan gmaclennan linked a pull request Aug 5, 2023 that will close this issue
2 tasks
@gmaclennan
Copy link
Member Author

Done in #149

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant