vllm only has /health endpoint #241
Labels
needs-kind
Indicates a PR lacks a label and requires one.
needs-priority
Indicates a PR lacks a label and requires one.
needs-triage
Indicates an issue or PR lacks a label and requires one.
What would you like to be added:
We'll have
startup
,liveness
andreadiness
probes for inference workloads, but vllm only supports/health
endpoint, see discussion here: vllm-project/vllm#7078,Why is this needed:
Completion requirements:
This enhancement requires the following artifacts:
The artifacts should be linked in subsequent comments.
The text was updated successfully, but these errors were encountered: