Skip to content
This repository has been archived by the owner on Mar 6, 2024. It is now read-only.

Support gpt 3.5 turbo 16k model #424

Merged
merged 1 commit into from
Aug 11, 2023

Conversation

HyunggyuJang
Copy link
Contributor

@HyunggyuJang HyunggyuJang commented Aug 9, 2023

TokenLimits is only the place needed to be modified. Have set the token limits accordingly. Closes #406

Summary by CodeRabbit

New Feature:

  • Added support for the "gpt-3.5-turbo-16k" model in the TokenLimits class.
  • Set the maxTokens limit to 16300 and the responseTokens limit to 3000 for the new model.

🎉 With tokens aplenty, we set the stage,
For the "gpt-3.5-turbo-16k" to engage.
More power, more wisdom, in every page,
A new chapter begins, let's turn the page! 🚀

@github-actions
Copy link
Contributor

github-actions bot commented Aug 9, 2023

Image description CodeRabbit

Walkthrough

The changes introduced in this pull request primarily focus on extending the functionality of the TokenLimits class. This is achieved by adding support for a new model, "gpt-3.5-turbo-16k". The token limits for this model have been set to ensure optimal performance and compliance with the model's specifications.

Changes

File Summary
src/limits.ts The TokenLimits class has been updated to include support for the "gpt-3.5-turbo-16k" model. The maximum tokens limit has been set to 16300 and the response tokens limit to 3000 for this model.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Image description CodeRabbit

Commits Files that changed from the base of the PR and between 500adcb and 1725d32 commits.
Files selected (1)
  • src/limits.ts (1)
Review comments generated (1)
  • Review: 1
  • LGTM: 0

Tips

Chat with Image description CodeRabbit Bot (@coderabbitai)

  • Reply on review comments left by this bot to ask follow-up questions. A review comment is a comment on a diff or a file.
  • Invite the bot into a review comment chain by tagging @coderabbitai in a reply.

Code suggestions

  • The bot may make code suggestions, but please review them carefully before committing since the line number ranges may be misaligned.
  • You can edit the comment made by the bot and manually tweak the suggestion if it is slightly off.

Pausing incremental reviews

  • Add @coderabbitai: ignore anywhere in the PR description to pause further reviews from the bot.

src/limits.ts Outdated Show resolved Hide resolved
`TokenLimits` is only the place needed to be modified. Have set the token limits accordingly.
@HyunggyuJang HyunggyuJang force-pushed the HyunggyuJang-patch-1 branch from 1725d32 to ffb4dca Compare August 9, 2023 09:10
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Image description CodeRabbit

Commits Files that changed from the base of the PR and between 500adcb and ffb4dca commits.
Files selected (1)
  • src/limits.ts (1)
Files skipped from review due to trivial changes (1)
  • src/limits.ts
Review comments generated (0)
  • Review: 0
  • LGTM: 0

Tips

Chat with Image description CodeRabbit Bot (@coderabbitai)

  • Reply on review comments left by this bot to ask follow-up questions. A review comment is a comment on a diff or a file.
  • Invite the bot into a review comment chain by tagging @coderabbitai in a reply.

Code suggestions

  • The bot may make code suggestions, but please review them carefully before committing since the line number ranges may be misaligned.
  • You can edit the comment made by the bot and manually tweak the suggestion if it is slightly off.

Pausing incremental reviews

  • Add @coderabbitai: ignore anywhere in the PR description to pause further reviews from the bot.

@harjotgill harjotgill merged commit 4c02adf into coderabbitai:main Aug 11, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Feature - Additional model support
2 participants