Installation llama.cpp sous Windows 11 avec Ubuntu 22

Remi

Pas possible de faire le build :

# cmake .. -G Ninja   -DCMAKE_C_COMPILER=/opt/rocm/llvm/bin/clang   -DCMAKE_CXX_COMPILER=/opt/rocm/llvm/bin/clang++   -DCMAKE_CXX_FLAGS="-I/opt/rocm/include"   -DCMAKE_CROSSCOMPILING=ON   -DCMAKE_BUILD_TYPE=Release   -DGPU_TARGETS="gfx1151"   -DBUILD_SHARED_LIBS=ON   -DLLAMA_BUILD_TESTS=OFF   -DGGML_HIP=ON   -DGGML_OPENMP=OFF   -DGGML_CUDA_FORCE_CUBLAS=OFF   -DGGML_HIP_ROCWMMA_FATTN=OFF   -DLLAMA_CURL=OFF   -DGGML_NATIVE=OFF   -DGGML_STATIC=OFF   -DCMAKE_SYSTEM_NAME=Linux -DCMAKE_HIP_COMPILER_ROCM_ROOT=/opt/rocm-7.2.4/core-7.14 -DCMAKE_PREFIX_PATH=/opt/rocm-7.2.4/core-7.14
CMAKE_BUILD_TYPE=Release
-- Setting GGML_NATIVE_DEFAULT to OFF
-- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF
-- CMAKE_SYSTEM_PROCESSOR:
-- GGML_SYSTEM_ARCH: UNKNOWN
-- Including CPU backend
CMake Warning at ggml/src/ggml-cpu/CMakeLists.txt:570 (message):
  Unknown CPU architecture.  Falling back to generic implementations.
Call Stack (most recent call first):
  ggml/src/CMakeLists.txt:470 (ggml_add_cpu_backend_variant_impl)


-- Adding CPU backend variant ggml-cpu: -DGGML_CPU_GENERIC
-- The HIP compiler identification is unknown
CMake Error at /usr/share/cmake-3.28/Modules/CMakeDetermineHIPCompiler.cmake:217 (message):
  The ROCm root directory:

   /opt/rocm-7.2.4/core-7.14

  does not contain the HIP runtime CMake package, expected at one of:

   /opt/rocm-7.2.4/core-7.14/lib/cmake/hip-lang/hip-lang-config.cmake
   /opt/rocm-7.2.4/core-7.14/lib64/cmake/hip-lang/hip-lang-config.cmake

Call Stack (most recent call first):
  ggml/src/ggml-hip/CMakeLists.txt:43 (enable_language)

-- Configuring incomplete, errors occurred!

Remi

Aie …

# /opt/rocm/bin/hipconfig --full
Warning: HIP version file: "/opt/rocm-7.2.4/core-7.14/hip/share/hip/version" not found.  Cannot give HIP version information.
Warning: HIP version file: "/opt/rocm-7.2.4/core-7.14/hip/share/hip/version" not found.  Cannot give HIP version information.
HIP version:

==hipconfig
HIP_PATH           :/opt/rocm-7.2.4/core-7.14/hip
ROCM_PATH          :/opt/rocm-7.2.4/core-7.14
HIP_COMPILER       :clang
HIP_PLATFORM       :amd
HIP_RUNTIME        :rocclr
CPP_CONFIG         : -D__HIP_PLATFORM_HCC__= -D__HIP_PLATFORM_AMD__= -I/opt/rocm-7.2.4/core-7.14/hip/include -I/include

==hip-clang
HIP_CLANG_PATH     :/opt/rocm-7.2.4/core-7.14/lib/llvm/bin
AMD clang version 23.0.0git (https://github.com/ROCm/llvm-project.git 46fcb339fb61119b337f973c7ca9e710a319fdd0+PATCHED:440716f8b87be9d8e20ed910e10e5b6d14d57cf6)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /opt/rocm-7.2.4/core-7.14/lib/llvm/bin
sh: 1: /opt/rocm-7.2.4/core-7.14/lib/llvm/bin/llc: not found
hip-clang-cxxflags :
sh: 1: /opt/rocm-7.2.4/core-7.14/hip/bin/hipcc: not found

hip-clang-ldflags :
sh: 1: /opt/rocm-7.2.4/core-7.14/hip/bin/hipcc: not found


== Environment Variables
PATH =/opt/vulkan-sdk/x86_64/bin:/root/.nvm/versions/node/v26.3.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
LD_LIBRARY_PATH=/opt/vulkan-sdk/x86_64/lib/VulkanLoader/lib
HIP_PATH=/opt/rocm-7.2.4/core-7.14/hip

== Linux Kernel
Hostname      :
pcremi
Linux pcremi 6.18.33.1-microsoft-standard-WSL2 #1 SMP PREEMPT_DYNAMIC Fri Jun  5 01:12:21 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 24.04.4 LTS
Release:        24.04
Codename:       noble

Remi

Nouveau test : https://rocm.docs.amd.com/projects/llama-cpp/en/docs-25.08/install/llama-cpp-install.html

Remi

Lancement de docker :

# docker run -it       --name=$(whoami)_llamacpp       --privileged --network=host       --device=/dev/kfd --device=/dev/dri       --group-add video --cap-add=SYS_PTRACE       --security-opt seccomp=unconfined       --ipc=host --shm-size 16G       -v $MODEL_PATH:/data rocm/dev-ubuntu-24.04:6.4-complete

Remi

Il faut déplacer votre distribution Ubuntu WSL vers un autre disque …

Remi

Aie …

#  llama-bench -m  /models/qwen2.5-1.5b-instruct-q4_k_m.gguf
llama-bench: error while loading shared libraries: libllama-bench-impl.so: cannot open shared object file: No such file or directory

Pourtant pas de problème de compilation avec https://rocm.docs.amd.com/projects/llama-cpp/en/docs-25.08/install/llama-cpp-install.html

Cela ne fonctionne pas :

# ./build/bin/test-backend-ops
ggml_cuda_init: failed to initialize ROCm: no ROCm-capable device is detected
Testing 1 devices

Backend 1/1: CPU
  Skipping CPU backend
1/1 backends passed
OK

Alors que j’ai fait le build pour toutes les architectures :

export LLAMACPP_ROCM_ARCH=gfx803,gfx900,gfx906,gfx908,gfx90a,gfx942,gfx1010,gfx1030,gfx1032,gfx1100,gfx1101,gfx1102

Remi

J’essaye de déplacer …

PS C:\Windows\system32> wsl --list --verbose
  NAME      STATE           VERSION
* Ubuntu    Running         2
PS C:\Windows\system32> wsl --terminate Ubuntu
L’opération a réussi.
PS C:\Windows\system32> wsl --list --verbose
  NAME      STATE           VERSION
* Ubuntu    Stopped         2
PS C:\Windows\system32> wsl --manage Ubuntu --move D:\WSL\Ubuntu
Le processus ne peut pas accéder au fichier car ce fichier est utilisé par un autre processus.
Code d'erreur : Wsl/Service/MoveDistro/ERROR_SHARING_VIOLATION
PS C:\Windows\system32> wsl --manage Ubuntu --move D:\WSL\Ubuntu
Le processus ne peut pas accéder au fichier car ce fichier est utilisé par un autre processus.
Code d'erreur : Wsl/Service/MoveDistro/ERROR_SHARING_VIOLATION

Remi

Ouf …

PS C:\Windows\system32> wsl --shutdown
PS C:\Windows\system32> wsl --manage Ubuntu --move D:\WSL\Ubuntu
L’opération a réussi.

Remi

Nouveau build :

# export LLAMACPP_ROCM_ARCH=gfx803,gfx900,gfx906,gfx908,gfx90a,gfx942,gfx1010,gfx1030,gfx1032,gfx1100,gfx1101,gfx1102
# HIPCXX="$(hipconfig -l)/clang" HIP_PATH="$(hipconfig -R)" \
cmake -S . -B build -DGGML_HIP=ON -DAMDGPU_TARGETS=$LLAMACPP_ROCM_ARCH \
-DCMAKE_BUILD_TYPE=Release -DLLAMA_CURL=ON \
&& cmake --build build --config Release -j$(nproc)

Remi

Je vais essayer la version Docker :

# export MODEL_PATH='/models/'
# docker run --privileged            --network=host            --device=/dev/kfd            --device=/dev/dri            --group-add video            --cap-add=SYS_PTRACE            --security-opt seccomp=unconfined            --ipc=host            --shm-size 16G            -v $MODEL_PATH:/data            rocm/llama.cpp:llama.cpp-b5997_rocm6.4.0_ubuntu24.04_full              -m /data/Qwen3.6-27B-Q4_K_M.gguf              -p "Building a website can be done in 10 simple steps:" -n 512 --n-gpu-layers 999
Unable to find image 'rocm/llama.cpp:llama.cpp-b5997_rocm6.4.0_ubuntu24.04_full' locally
llama.cpp-b5997_rocm6.4.0_ubuntu24.04_full: Pulling from rocm/llama.cpp
757fe5b21110: Downloading [==>                                                ]  6.291MB/114.7MB
0f1832fb3fb1: Downloading [>                                                  ]  5.243MB/646.4MB
52ae0682347f: Downloading [======================================>            ]    107MB/138.7MB
b00fa23324d1: Pull complete

NodeBB

Installation llama.cpp sous Windows 11 avec Ubuntu 22