Explain where the engine args go when using Docker (vllm-project#12041)

Signed-off-by: Harry Mellor <[email protected]> Signed-off-by: Bowen Wang <[email protected]>
abmfy · Jan 24, 2025 · 18f12d6 · 18f12d6
1 parent 18a59b8
commit 18f12d6
Showing 1 changed file with 2 additions and 0 deletions.
diff --git a/docs/source/deployment/docker.md b/docs/source/deployment/docker.md
@@ -19,6 +19,8 @@ $ docker run --runtime nvidia --gpus all \
     --model mistralai/Mistral-7B-v0.1
 ```
 
+You can add any other <project:#engine-args> you need after the image tag (`vllm/vllm-openai:latest`).
+
 ```{note}
 You can either use the `ipc=host` flag or `--shm-size` flag to allow the
 container to access the host's shared memory. vLLM uses PyTorch, which uses shared