Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speed up retrieval of lemma suggestions #72

Open
mbollmann opened this issue Jan 7, 2016 · 0 comments
Open

Speed up retrieval of lemma suggestions #72

mbollmann opened this issue Jan 7, 2016 · 0 comments

Comments

@mbollmann
Copy link
Member

Originally reported by: Marcel Bollmann (Bitbucket: mbollmann, GitHub: mbollmann)


Users report that retrieving lemma suggestions can sometimes take up to 7 seconds, which is huge.

The testing script introduced in commit 1e1f888 suggests that the part which retrieves lemma suggestions from other texts within the project (with the same "ascii" token) is a major bottleneck, taking almost a full second for one lookup on the production database.

If there is no evidence for other factors, refactoring this lookup should be considered.

A possible solution could be to introduce another database table which maps (project_id, mod_ascii) pairs to tag_ids of lemma annotations. This table would have to be updated whenever lemma annotations are saved, and could then be used for efficient lookup during retrieval.


Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant