Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch to elastic #18

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

Switch to elastic #18

wants to merge 4 commits into from

Conversation

AVakiliT
Copy link
Contributor

...

@AVakiliT AVakiliT marked this pull request as ready for review November 2, 2020 12:28
@AVakiliT
Copy link
Contributor Author

AVakiliT commented Nov 13, 2020

Okay so apologies for taking so long to finish this, things got hectic and I completely forgot about this branch.
I changed the search ip and port in the settings file to what you used in production

Now this branch will switch the code completely over to elasticsearch even in development. For local development docker compose should be started with the command docker-compose -f docker-compose.yml -f dev.yml up.

The elastic athome4 collection index can be downloaded from https://www.dropbox.com/s/j9ym9f5zt5c0ex8/esdata.7z?dl=0 and should be placed in the data folder.

@AVakiliT AVakiliT requested a review from ammsa November 13, 2020 12:34
@AVakiliT
Copy link
Contributor Author

AVakiliT commented Nov 13, 2020

Your cc-prod way of doing things was a lot cleaner so I tried to emulate that. Now development uses env variables for search stuff as well. I added two env variables INDEX_NAME and SEARCH_ENGINE so we can switch between the two search engines. Their defaults are elastic and commoncrawl so you won't need to change anything in production.

You can witch between engines with the commands docker-compose -f docker-compose.yml -f ./dev/dev_anserini.yml up and docker-compose -f docker-compose.yml -f ./dev/dev_elastic.yml up

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant