llama.cpp : llama-server : Erreur 404 file not found

[Tuxedo17]

C’est à cause de npm :

# curl https://raw.githubusercontent.com/creationix/nvm/master/install.sh | bash
...
# source ~/.profile
...
# nvm install node
...
# nvm install 24
...
# nvm use 24
Now using node v24.17.0 (npm v11.13.0)

Ensuite il faut refaire un build de llama.cpp.

[Tuxedo17]

Un autre problème l’absence de NCCL :

# apt install libnccl2 libnccl-dev

[Tuxedo17]

Les logs avant le build :

# export LD_LIBRARY_PATH=/usr/local/cuda/lib
# export PATH=$PATH:/usr/local/cuda/bin
# cmake .. -DGGML_CUDA=ON
CMAKE_BUILD_TYPE=Release
-- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF
-- CMAKE_SYSTEM_PROCESSOR: x86_64
-- GGML_SYSTEM_ARCH: x86
-- Including CPU backend
-- x86 detected
-- Adding CPU backend variant ggml-cpu: -march=native 
-- CUDA Toolkit found
-- Using CMAKE_CUDA_ARCHITECTURES=75-virtual;80-virtual;86-real;89-real;90-virtual;120a-real;121a-real CMAKE_CUDA_ARCHITECTURES_NATIVE=
-- CUDA host compiler is GNU 11.4.0
-- Including CUDA backend
-- ggml version: 0.15.1
-- ggml commit:  b4024af6c
-- OpenSSL found: 3.0.2
-- Generating embedded license file for target: llama-app
-- Configuring done
-- Generating done
-- Build files have been written to: /home/XXXX/GIT/llama.cpp/build