Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update llama 3.3 versatile #15726

Merged
merged 6 commits into from
Dec 16, 2024
Merged

update llama 3.3 versatile #15726

Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
84739f5
update llama 3.3 versatile
sinanazeri Dec 6, 2024
b8f4b62
Update CHANGELOG.md
sinanazeri Dec 6, 2024
65336e8
fixed names
maximilianzuern Dec 13, 2024
217d9e1
added 'Llama 3.3 70B SpecDec 8k'
maximilianzuern Dec 13, 2024
f6d6d29
updated package.json
maximilianzuern Dec 13, 2024
6cebc83
Merge pull request #1 from maximilianzuern/groq-llama3.3
sinanazeri Dec 13, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 4 additions & 1 deletion extensions/groq/CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,8 @@
# Groq Changelog

## [New Models] - 2024-12-06
- Added `Llama 3.3 70B`

## [New Models] - 2024-07-26

- Added `Llama 3.1 8B` and `Llama 3.1 70B`
Expand Down Expand Up @@ -30,4 +33,4 @@
- Added new model `Gemma 7B`


## [Initial Version] - 2024-03-01
## [Initial Version] - 2024-03-01
2 changes: 2 additions & 0 deletions extensions/groq/src/hook/utils.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@ export const allModels = [
{ name: "Follow global model", id: "global" },
{ name: "Llama3.1 8B 132k", id: "llama-3.1-8b-instant" },
{ name: "Llama3.1 70B 132k", id: "llama-3.1-70b-versatile" },
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
{ name: "Llama3.1 70B 132k", id: "llama-3.1-70b-versatile" },
{ name: "Llama3.3 70B 132k", id: "llama-3.3-70b-versatile" },

{ name: "Llama3.3 70B Versatile", id: "llama-3.3-70b-versatile" },
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
{ name: "Llama3.3 70B Versatile", id: "llama-3.3-70b-versatile" },

{ name: "Llama3 8B 8k", id: "llama3-8b-8192" },
{ name: "Llama3 70B 8k", id: "llama3-70b-8192" },
{ name: "Mixtral 8x7B 32k", id: "mixtral-8x7b-32768" },
Expand Down Expand Up @@ -34,6 +35,7 @@ export function estimatePrice(prompt_token: number, output_token: number, model:
break;
case "llama3-70b-8192":
case "llama-3.1-70b-versatile":
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
case "llama-3.1-70b-versatile":
case "llama-3.3-70b-versatile":

case "llama-3.3-70b-versatile":
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
case "llama-3.3-70b-versatile":

price = ((prompt_token * 0.59) / 1_000_000 + (output_token * 0.79) / 1_000_000) * 100;
break;
case "llama3-8b-8192":
Expand Down
Loading