Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Search performance issue when using Elasticsearch [7.7.0, 7.8.x] #626

Closed
cmark opened this issue Aug 5, 2020 · 1 comment · Fixed by #641
Closed

Search performance issue when using Elasticsearch [7.7.0, 7.8.x] #626

cmark opened this issue Aug 5, 2020 · 1 comment · Fixed by #641
Assignees
Labels

Comments

@cmark
Copy link
Member

cmark commented Aug 5, 2020

Describe the bug
Significant performance drop in searches/aggregations when using Elasticsearch 7.7.0+ in Snow Owl 7.7.0+ release.

To Reproduce

Run a validation rule that uses either a search or aggregation with a large number of terms filter values (all active concept IDs listed, huge ECL/QL result set, etc.).

Expected behavior
Running any search with large number of term filter values should not cause significant performance drop in computation time.

Version

  • Snow Owl Version: 7.7.0, 7.8.0
  • Elasticsearch Version (external): 7.7.0, 7.8.0

Additional context
Elasticsearch PR where the Percolator FetchPhase implementation rewrite happened:
elastic/elasticsearch#53728
Lucene 8.6.0 PR where the potential fix has been introduced:
apache/lucene-solr#1465
Related Elastic.co Discussion:
https://discuss.elastic.co/t/performance-problem-in-percolator-fetch-phase-classes/243748

This performance issue is going to be fixed when Elasticsearch 7.9.0 releases (it uses Lucene 8.6.0 under the hood).

@cmark
Copy link
Member Author

cmark commented Aug 19, 2020

Elasticsearch 7.9.0 is available, and Snow Owl now supports that, resolving as fixed.

@cmark cmark pinned this issue Oct 12, 2020
@kovacstomi kovacstomi unpinned this issue Mar 22, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant