-
Notifications
You must be signed in to change notification settings - Fork 5.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: add stepfun integrations #17514
Conversation
@masci |
sample code from llama_index.llms.stepfun import StepFun
from llama_index.core.llms import ChatMessage
llm = StepFun(
api_key="",
max_tokens=256,
context_window=4096,
model="step-1v-8k",
)
message = ChatMessage(role="user", content="Tell me a joke")
resp = llm.chat([message])
print(resp) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Left a couple of comments. Can you also fix the linting problems? If you install our pre-commit hook that should be super easy pre-commit install
llama-index-integrations/llms/llama-index-llms-stepfun/README.md
Outdated
Show resolved
Hide resolved
llama-index-integrations/llms/llama-index-llms-stepfun/tests/BUILD
Outdated
Show resolved
Hide resolved
done with pre-commit @masci |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you fix the linting?
let me run line local & fix it! |
@masci waiting approve for run lint. |
|
llama-index-integrations/llms/llama-index-llms-stepfun/pyproject.toml
Outdated
Show resolved
Hide resolved
llama-index-integrations/llms/llama-index-llms-stepfun/pyproject.toml
Outdated
Show resolved
Hide resolved
@bestony the package publishing job is failing because we don't have write permissions on https://pypi.org/project/llama-index-llms-stepfun/ - My bad I didn't check the package already existed. Best course of action would be you yank the existing releases and add |
@masci my bad, i think i need publish it first. i add jerryjliu as owner, so maybe in next version, pkackage publish job will work fine! |
Description
Add new LLM Vendor named "stepfun" for https://platform.stepfun.com/
New Package?
Did I fill in the
tool.llamahub
section in thepyproject.toml
and provide a detailed README.md for my new integration or package?Type of Change
Please delete options that are not relevant.
How Has This Been Tested?
Your pull-request will likely not be merged unless it is covered by some form of impactful unit testing.
Suggested Checklist:
make format; make lint
to appease the lint gods