Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

About TouchStone #5

Closed
tfka opened this issue Aug 24, 2023 · 2 comments
Closed

About TouchStone #5

tfka opened this issue Aug 24, 2023 · 2 comments

Comments

@tfka
Copy link

tfka commented Aug 24, 2023

TouchStone is a VQA benchmark or a multi-turn dialogue benchmark? Will this benchmark be open-source?
@ShuaiBai623
Copy link
Collaborator

  1. The current testing results of TouchStone v0.1 only include single-turn conversations, but we plan to expand it to encompass multi-turn dialogues in the future.
  2. We will soon release a technical report to provide an overview of the evaluation process and the detailed results. The benchmark will be open-sourced in the future.

@ShuaiBai623
Copy link
Collaborator

Thanks for your attention, we add more details in the paper.
The evaluation script is provided at this repo

This was referenced Apr 7, 2024
Open
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@tfka @JustinLin610 @ShuaiBai623