Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Installation][build][docker]: rocm Dockerfile pinned to stale python torch nightly wheel builds #12066

Closed
1 task done
ghost opened this issue Jan 15, 2025 · 3 comments · Fixed by #12172
Closed
1 task done
Labels
installation Installation problems rocm

Comments

@ghost
Copy link

ghost commented Jan 15, 2025

How you are installing vllm

vllm/Dockerfile.rocm

Lines 48 to 58 in 0794e74

# Install torch == 2.6.0 on ROCm
RUN --mount=type=cache,target=/root/.cache/pip \
case "$(ls /opt | grep -Po 'rocm-[0-9]\.[0-9]')" in \
*"rocm-6.2"*) \
python3 -m pip uninstall -y torch torchvision \
&& python3 -m pip install --pre \
torch==2.6.0.dev20241113+rocm6.2 \
'setuptools-scm>=8' \
torchvision==0.20.0.dev20241113+rocm6.2 \
--extra-index-url https://download.pytorch.org/whl/nightly/rocm6.2;; \
*) ;; esac

Python packages for torch==2.6.0.dev20241113+rocm6.2 and torchvision==0.20.0.dev20241113+rocm6.2 are no longer available due to them being outside of the build retention window

Wheel Index:
https://download.pytorch.org/whl/nightly/torch/

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
@ghost ghost added the installation Installation problems label Jan 15, 2025
@ghost
Copy link
Author

ghost commented Jan 15, 2025

In Process:
Building and verifying with latest nightlies for rocm6.2

torch==2.6.0.dev20241122+rocm6.2
torchvision==0.20.0.dev20241123+rocm6.2

@ghost ghost changed the title [Installation][build]: rocm Dockerfile pinned to stale python torch nightly wheel builds [Installation][build][docker]: rocm Dockerfile pinned to stale python torch nightly wheel builds Jan 15, 2025
@hongxiayang
Copy link
Collaborator

@cob-web-corner Please test this one since the PyTorch stable release is already on ROCm 6.2 :

pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/rocm6.2

We will check to update the Dockerfile.

@ghost
Copy link
Author

ghost commented Jan 17, 2025

@hongxiayang Thank you, not a usual AMD+PyTorch user

Confirmed working on MI300X, MI300A and MI250

This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
installation Installation problems rocm
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant