-
Notifications
You must be signed in to change notification settings - Fork 178
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ai: update llm tokens used #3372
Conversation
This commit updates the codebase to use the new LLM OpenAPI spec, which replaces `tokens_used` with `usage`. See livepeer/ai-worker#402 for more details.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Tested with updated go.sum after merger livepeer/ai-worker PR #402 locally streaming and non-streaming responses.
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## master #3372 +/- ##
===================================================
+ Coverage 33.69179% 33.69623% +0.00444%
===================================================
Files 141 141
Lines 37475 37476 +1
===================================================
+ Hits 12626 12628 +2
+ Misses 24127 24126 -1
Partials 722 722
... and 2 files with indirect coverage changes Continue to review full report in Codecov by Sentry.
|
What does this pull request do? Explain your changes. (required)
Important
Merge #3336 and livepeer/ai-worker#402 first and release runner v0.13.2.
This pull request updates the codebase to use the new LLM OpenAPI spec, which replaces
tokens_used
withusage
. See livepeer/ai-worker#402 for more details.Specific updates (required)
ai_process.go
to use the new ai-worker client bindings.How did you test each of these updates (required)
Run an on-chain Gateway and Orchestrator.
Does this pull request close any open issues?
No, but it implements the change discussed in https://discordapp.com/channels/423160867534929930/1319248702032056383/1332619710562439168.
Checklist:
make
runs successfully./test.sh
pass