Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update the ROCm version to 6.2 #5427

Merged
merged 1 commit into from
Sep 13, 2024
Merged

Update the ROCm version to 6.2 #5427

merged 1 commit into from
Sep 13, 2024

Conversation

HardAndHeavy
Copy link
Contributor

When upgrading to the latest version of ROCm, the vLLM installation error was fixed.

Tested on AMD Radeon RX 7900 XTX.

The image is assembled without errors when setting the arguments to true

services:
  llamafactory:
    build:
      dockerfile: ./docker/docker-rocm/Dockerfile
      context: ../..
      args:
        INSTALL_BNB: true
        INSTALL_VLLM: true
        INSTALL_DEEPSPEED: true
        INSTALL_FLASHATTN: true

@hiyouga
Copy link
Owner

hiyouga commented Sep 13, 2024

LGTM!

@hiyouga hiyouga merged commit a766177 into hiyouga:main Sep 13, 2024
@hiyouga hiyouga added the solved This problem has been already solved label Sep 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
solved This problem has been already solved
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants