Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replication logs for Robost04 and Core18 #977

Merged
merged 1 commit into from
Jan 27, 2020
Merged

Replication logs for Robost04 and Core18 #977

merged 1 commit into from
Jan 27, 2020

Conversation

edwinzhng
Copy link
Member

@edwinzhng edwinzhng commented Jan 26, 2020

I also added a comment about letting the index "catch up"

Will need to rebase with #976 before merging

@edwinzhng edwinzhng requested a review from lintool January 26, 2020 23:28
@codecov
Copy link

codecov bot commented Jan 26, 2020

Codecov Report

Merging #977 into master will decrease coverage by 0.01%.
The diff coverage is n/a.

Impacted file tree graph

@@             Coverage Diff              @@
##             master     #977      +/-   ##
============================================
- Coverage     39.61%   39.59%   -0.02%     
+ Complexity      510      509       -1     
============================================
  Files           121      121              
  Lines          7326     7326              
  Branches       1094     1094              
============================================
- Hits           2902     2901       -1     
  Misses         4135     4135              
- Partials        289      290       +1
Impacted Files Coverage Δ Complexity Δ
...anserini/ltr/feature/base/PMIFeatureExtractor.java 84.61% <0%> (-1.93%) 12% <0%> (-1%)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 643c347...d950376. Read the comment docs.

@@ -76,6 +76,8 @@ sh target/appassembler/bin/IndexCollection -collection JsonCollection -generator
-es -es.index msmarco-passage -threads 9 -input /path/to/msmarco-passage -storePositions -storeDocvectors -storeRawDocs
```

We may need to wait a few minutes after indexing for the index to catch up before performing retrievals, otherwise wrong evaluation metrics are returned.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

retrievals -> retrieval

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated, also lumped in some other replication logs in here too

@edwinzhng edwinzhng changed the title Replication log for Robost04 on Elastirini Replication logs for Robost04 and Core18 Jan 27, 2020
@lintool
Copy link
Member

lintool commented Jan 27, 2020

Replicate notes here should be added to template: https://github.com/castorini/anserini/blob/master/src/main/resources/docgen/templates/core18.template

Maven build auto-generates .md file. See #974

@lintool lintool merged commit 1882d84 into castorini:master Jan 27, 2020
@edwinzhng edwinzhng deleted the update-elastirini-doc branch January 27, 2020 18:29
crystina-z pushed a commit to crystina-z/anserini that referenced this pull request Oct 28, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants