Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: add stream_usage true to collect token usage #27568

Merged
merged 4 commits into from
Jan 15, 2025

Conversation

k11kirky
Copy link
Contributor

Problem

If streaming = True in our ChatOpenAI models, we need to also include stream_usage = true to collect tokens

@k11kirky k11kirky requested review from Twixes and skoob13 January 15, 2025 20:57
Copy link

sentry-io bot commented Jan 15, 2025

🔍 Existing Issues For Review

Your pull request is modifying functions with the following pre-existing issues:

📄 File: ee/hogai/summarizer/nodes.py

Function Unhandled Issue
run ValueError: Can only run summarization with a visualization message as the last one in the state ...
Event Count: 13
run ValueError: Can only run summarization with a visualization message as the last one in the state /api/env...
Event Count: 13
run KeyError: 'results' /api/environments/{parent_loo...
Event Count: 4
run KeyError: 'results' ee.hogai.summarizer.nodes in run
Event Count: 4

Did you find this useful? React with a 👍 or 👎

@k11kirky k11kirky requested a review from timgl January 15, 2025 20:57
@k11kirky k11kirky enabled auto-merge (squash) January 15, 2025 21:10
@k11kirky k11kirky merged commit 8e94418 into master Jan 15, 2025
92 checks passed
@k11kirky k11kirky deleted the fix/assistant-stream-usage branch January 15, 2025 22:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants