[Feature] Can we remove api-key authentication from the /health endpoint?

[ucciicci]

Motivation

Currently, when the server is started with an api-key, the /health endpoint also requires the api-key for requests.
Some cloud services' health check functions cannot set authentication information for requests, causing issues with deployment health checks.
Is it possible to remove the authentication check from the /health endpoint?

For reference, in vllm, the /health endpoint does not require authentication.

Related resources

No response

[zhyncs]

You may set ‘EMPTY’.

[ucciicci]

Thank you for your response.

What I would like to achieve is to have api-key authentication for inference endpoints (e.g., /v1/completions), but allow the /health endpoint to respond with a 200 status without requiring authentication.

sglang/python/sglang/srt/server.py

Line 90 in 001b0bd

@app.get("/health")

sglang/python/sglang/srt/utils.py

Line 545 in 001b0bd

class APIKeyValidatorMiddleware(BaseHTTPMiddleware):

[Ying1123]

Should be fixed by #917