Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BFCL] Add New Model watt-tool-8B and watt-tool-70B #847

Merged
merged 3 commits into from
Dec 21, 2024
Merged

[BFCL] Add New Model watt-tool-8B and watt-tool-70B #847

merged 3 commits into from
Dec 21, 2024
+17 −0

Conversation

zhanghanduo
Copy link
Contributor

This PR adds the model watt-ai/watt-tool-8B and watt-ai/watt-tool-70B to the leaderboard.

zhanghanduo and others added 2 commits December 20, 2024 13:30
@zhanghanduo
Add new models 'watt-ai/watt-tool-8B' and 'watt-ai/watt-tool-70B'

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode
7a49c43
@zhanghanduo
Update model_metadata.py
56b1fc9
HuanzhiMao
HuanzhiMao approved these changes Dec 21, 2024
View reviewed changes
Copy link
Collaborator

@HuanzhiMao HuanzhiMao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR @zhanghanduo!
Once you sync this branch with the latest changes from the main branch, I’ll be happy to merge it. Currently there are some conflicts that are blocking the merge, and I don't have write access to your branch.

@zhanghanduo
Copy link
Contributor Author

zhanghanduo commented Dec 21, 2024 •
edited
Loading

Thanks for the PR @zhanghanduo! Once you sync this branch with the latest changes from the main branch, I’ll be happy to merge it. Currently there are some conflicts that are blocking the merge, and I don't have write access to your branch.

Hi, @HuanzhiMao Thanks for pointing out that conflict. I have merged the update that happened after our submission.

@HuanzhiMao HuanzhiMao merged commit 1792fb1 into ShishirPatil:main Dec 21, 2024
@HuanzhiMao HuanzhiMao added the BFCL-New Model Add New Model to BFCL label Dec 23, 2024
@HuanzhiMao HuanzhiMao mentioned this pull request Dec 26, 2024
Merged
HuanzhiMao added a commit that referenced this pull request Dec 31, 2024
@HuanzhiMao
[BFCL] Leaderboard Update - 2024/12/29 (Checkpoint 0cea216) (#845)
1045ee2 
This PR updates the leaderboard to reflect the change in score due to
the following PR merge:

1. #822 
2. #826 
3. #829 
4. #832 
5. #837 
6. #840 
7. #835 
8. #842 
9.  #843 
10. #846 
11. #838 
12. #847 
13. #855 
14. #857 

Models were evaluated using checkpoint commit 0cea216.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@HuanzhiMao HuanzhiMao

Assignees
No one assigned
Labels
BFCL-New Model Add New Model to BFCL
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@zhanghanduo @HuanzhiMao