NodeBB

Sur l’interface : [image: image.png]

Nouveau test : # llama-bench -m /models/Qwen3.6-27B-Q3_K_M.gguf -dev CUDA0 -fa on --threads 12 -ngl 999 --cache-type-v q8_0 ggml_cuda_init: found 2 CUDA devices (Total VRAM: 21692 MiB): Device 0: NVIDIA GeForce RTX 5060 Ti, compute capability 12.0, VMM: yes, VRAM: 15888 MiB Device 1: NVIDIA GeForce RTX 3060 Laptop GPU, compute capability 8.6, VMM: yes, VRAM: 5803 MiB | model | size | params | backend | ngl | threads | type_v | fa | dev | test | t/s | | ------------------------------ | ---------: | ---------: | ---------- | --: | ------: | -----: | --: | ------------ | --------------: | -------------------: | | qwen35 27B Q3_K - Medium | 12.64 GiB | 26.90 B | CUDA | 999 | 12 | q8_0 | 1 | CUDA0 | pp512 | 387.17 ± 2.25 | | qwen35 27B Q3_K - Medium | 12.64 GiB | 26.90 B | CUDA | 999 | 12 | q8_0 | 1 | CUDA0 | tg128 | 18.31 ± 0.01 | # llama-bench -m /models/Qwen3.6-27B-Q3_K_M.gguf -fa on --threads 12 -ngl 999 --cache-type-v q8_0 ggml_cuda_init: found 2 CUDA devices (Total VRAM: 21692 MiB): Device 0: NVIDIA GeForce RTX 5060 Ti, compute capability 12.0, VMM: yes, VRAM: 15888 MiB Device 1: NVIDIA GeForce RTX 3060 Laptop GPU, compute capability 8.6, VMM: yes, VRAM: 5803 MiB | model | size | params | backend | ngl | threads | type_v | fa | test | t/s | | ------------------------------ | ---------: | ---------: | ---------- | --: | ------: | -----: | --: | --------------: | -------------------: | | qwen35 27B Q3_K - Medium | 12.64 GiB | 26.90 B | CUDA | 999 | 12 | q8_0 | 1 | pp512 | 367.28 ± 1.88 | | qwen35 27B Q3_K - Medium | 12.64 GiB | 26.90 B | CUDA | 999 | 12 | q8_0 | 1 | tg128 | 16.71 ± 0.03 |

L’export en Markdown ne fonctionne pas : # hermes sessions export --format md --older-than 90 --dry-run usage: hermes [-h] [--version] [-z PROMPT] [--usage-file PATH] [-m MODEL] [--provider PROVIDER] [-t TOOLSETS] [--resume SESSION] [--continue [SESSION_NAME]] [--worktree] [--accept-hooks] [--skills SKILLS] [--yolo] [--pass-session-id] [--ignore-user-config] [--ignore-rules] [--safe-mode] [--tui] [--cli] [--dev] {chat,model,moa,fallback,secrets,migrate,gateway,proxy,lsp,setup,postinstall,whatsapp,whatsapp-cloud,slack,send,login,logout,auth,status,cron,webhook,portal,kanban,project,hooks,doctor,security,dump,debug,backup,checkpoints,import,config,console,pairing,skills,bundles,plugins,curator,pets,journey,learning,memory-graph,memory,tools,computer-use,mcp,sessions,insights,claw,version,update,uninstall,acp,profile,completion,dashboard,serve,desktop,gui,logs,prompt-size} ... hermes: error: unrecognized arguments: --format --older-than 90 --dry-run

Les logs avant le build : # export LD_LIBRARY_PATH=/usr/local/cuda/lib # export PATH=$PATH:/usr/local/cuda/bin # cmake .. -DGGML_CUDA=ON CMAKE_BUILD_TYPE=Release -- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF -- CMAKE_SYSTEM_PROCESSOR: x86_64 -- GGML_SYSTEM_ARCH: x86 -- Including CPU backend -- x86 detected -- Adding CPU backend variant ggml-cpu: -march=native -- CUDA Toolkit found -- Using CMAKE_CUDA_ARCHITECTURES=75-virtual;80-virtual;86-real;89-real;90-virtual;120a-real;121a-real CMAKE_CUDA_ARCHITECTURES_NATIVE= -- CUDA host compiler is GNU 11.4.0 -- Including CUDA backend -- ggml version: 0.15.1 -- ggml commit: b4024af6c -- OpenSSL found: 3.0.2 -- Generating embedded license file for target: llama-app -- Configuring done -- Generating done -- Build files have been written to: /home/XXXX/GIT/llama.cpp/build