Aller directement au contenu
  • Installation llama.cpp sous Windows 11 avec Ubuntu 22

    Linux wsl2 llama.cpp
    28
    1 Votes
    28 Messages
    115 Vues
    R
    Je vais essayer la version Docker : # export MODEL_PATH='/models/' # docker run --privileged --network=host --device=/dev/kfd --device=/dev/dri --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --ipc=host --shm-size 16G -v $MODEL_PATH:/data rocm/llama.cpp:llama.cpp-b5997_rocm6.4.0_ubuntu24.04_full -m /data/Qwen3.6-27B-Q4_K_M.gguf -p "Building a website can be done in 10 simple steps:" -n 512 --n-gpu-layers 999 Unable to find image 'rocm/llama.cpp:llama.cpp-b5997_rocm6.4.0_ubuntu24.04_full' locally llama.cpp-b5997_rocm6.4.0_ubuntu24.04_full: Pulling from rocm/llama.cpp 757fe5b21110: Downloading [==> ] 6.291MB/114.7MB 0f1832fb3fb1: Downloading [> ] 5.243MB/646.4MB 52ae0682347f: Downloading [======================================> ] 107MB/138.7MB b00fa23324d1: Pull complete