Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove query level scorer capablity #132

Closed
epugh opened this issue May 22, 2020 · 2 comments
Closed

Remove query level scorer capablity #132

epugh opened this issue May 22, 2020 · 2 comments

Comments

@epugh
Copy link
Member

epugh commented May 22, 2020

Is your feature request related to a problem? Please describe.
A somewhat hidden feature is that you can set a scorer at the query level, that is used instead of the case level scorer!

This turns out, according to @softwaredoug, to come from the origin of Quepid.. Back before we added classical relevance metrics to Quepid, it was used more as an individaul query tool, and only later were queries grouped into cases.

Describe the solution you'd like
Rip out this capablity, because what is a AP@10 for one query when you are using NDCG@10 for the whole case mean?

Describe alternatives you've considered
While not exactly an alternative, we are keeping the adhoc scorer for now that lets you write unit tests in Quepid. Sure, you could do it in Python etc, but what if you want to pair with your content curator using Quepid?

Additional context
This will simplify our codebase in Angular1.

@epugh
Copy link
Member Author

epugh commented May 28, 2020

This has been completed in PR #100

@epugh
Copy link
Member Author

epugh commented May 31, 2020

Closed now that #100 is merged.

@epugh epugh closed this as completed May 31, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant