Skip to content
Publish Docker image

llama : save and restore kv cache for single seq id #10382

Sign in to view logs

llama : save and restore kv cache for single seq id

llama : save and restore kv cache for single seq id #10382

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Push Docker image to Docker Hub (light, .devops/main.Dockerfile, linux/amd64,linux/arm64)
25m 3s
Push Docker image to Docker Hub (full, .devops/full.Dockerfile, linux/amd64,linux/arm64)
29m 51s
Push Docker image to Docker Hub (server, .devops/server.Dockerfile, linux/amd64,linux/arm64)
24m 44s
Push Docker image to Docker Hub (light-cuda, .devops/main-cuda.Dockerfile, linux/amd64)
13m 33s
Push Docker image to Docker Hub (full-cuda, .devops/full-cuda.Dockerfile, linux/amd64)
16m 14s
Push Docker image to Docker Hub (server-cuda, .devops/server-cuda.Dockerfile, linux/amd64)
14m 55s
Push Docker image to Docker Hub (light-rocm, .devops/main-rocm.Dockerfile, linux/amd64,linux/arm64)
32m 51s
Push Docker image to Docker Hub (full-rocm, .devops/full-rocm.Dockerfile, linux/amd64,linux/arm64)
33m 42s
Push Docker image to Docker Hub (server-rocm, .devops/server-rocm.Dockerfile, linux/amd64,linux/a...
10m 13s
Push Docker image to Docker Hub (light-intel, .devops/main-intel.Dockerfile, linux/amd64)
7m 2s
Push Docker image to Docker Hub (server-intel, .devops/server-intel.Dockerfile, linux/amd64)
7m 3s
3h 35m 11s