Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support multi-host inference with Playground #235

Merged
merged 1 commit into from
Jan 16, 2025

Conversation

kerthcet
Copy link
Member

@kerthcet kerthcet commented Jan 13, 2025

What this PR does / why we need it

People can configure multi-host inference in Playground.

Which issue(s) this PR fixes

Fixes #61

Special notes for your reviewer

Does this PR introduce a user-facing change?

Support multi-host configuration in Playground

@InftyAI-Agent InftyAI-Agent added needs-triage Indicates an issue or PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. do-not-merge/needs-kind Indicates a PR lacks a label and requires one. labels Jan 13, 2025
@kerthcet kerthcet force-pushed the feat/fungibility branch 3 times, most recently from 5aede46 to 1eb7727 Compare January 16, 2025 09:43
@kerthcet
Copy link
Member Author

/kind feature

@InftyAI-Agent InftyAI-Agent added feature Categorizes issue or PR as related to a new feature. and removed do-not-merge/needs-kind Indicates a PR lacks a label and requires one. labels Jan 16, 2025
@kerthcet
Copy link
Member Author

/lgtm
/approve

@InftyAI-Agent InftyAI-Agent added lgtm Looks good to me, indicates that a PR is ready to be merged. approved Indicates a PR has been approved by an approver from all required OWNERS files. labels Jan 16, 2025
@InftyAI-Agent InftyAI-Agent merged commit de9e535 into InftyAI:main Jan 16, 2025
18 of 19 checks passed
@kerthcet kerthcet changed the title Support multi-host in inference Playground Support multi-host inference with Playground Jan 16, 2025
@kerthcet kerthcet deleted the feat/fungibility branch January 16, 2025 10:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. feature Categorizes issue or PR as related to a new feature. lgtm Looks good to me, indicates that a PR is ready to be merged. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

An an example for multi-host inference with Service
2 participants