Skip to content

Commit

Permalink
[shortfin llm] Remove unused ServerParams fields (#954)
Browse files Browse the repository at this point in the history
These were accidentally introduced and never used.
  • Loading branch information
renxida authored and eagarvey-amd committed Feb 14, 2025
1 parent 6f4bdc5 commit 2e59063
Showing 1 changed file with 0 additions and 6 deletions.
6 changes: 0 additions & 6 deletions shortfin/python/shortfin_apps/llm/components/config_struct.py
Original file line number Diff line number Diff line change
Expand Up @@ -215,12 +215,6 @@ class ServerParams:
# KV cache configuration
prefix_sharing_algorithm: str = "none" # none or trie

# Server runtime configuration
host: Optional[str] = None
port: int = 8000
root_path: Optional[str] = None
timeout_keep_alive: int = 5

# Program isolation configuration
program_isolation: str = "per_call"

Expand Down

0 comments on commit 2e59063

Please sign in to comment.