Nouveau test :
# llama-bench -m /models/Qwen3.6-27B-Q3_K_M.gguf -dev CUDA0 -fa on --threads 12 -ngl 999 --cache-type-v q8_0
ggml_cuda_init: found 2 CUDA devices (Total VRAM: 21692 MiB):
Device 0: NVIDIA GeForce RTX 5060 Ti, compute capability 12.0, VMM: yes, VRAM: 15888 MiB
Device 1: NVIDIA GeForce RTX 3060 Laptop GPU, compute capability 8.6, VMM: yes, VRAM: 5803 MiB
| model | size | params | backend | ngl | threads | type_v | fa | dev | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | ------: | -----: | --: | ------------ | --------------: | -------------------: |
| qwen35 27B Q3_K - Medium | 12.64 GiB | 26.90 B | CUDA | 999 | 12 | q8_0 | 1 | CUDA0 | pp512 | 387.17 ± 2.25 |
| qwen35 27B Q3_K - Medium | 12.64 GiB | 26.90 B | CUDA | 999 | 12 | q8_0 | 1 | CUDA0 | tg128 | 18.31 ± 0.01 |
# llama-bench -m /models/Qwen3.6-27B-Q3_K_M.gguf -fa on --threads 12 -ngl 999 --cache-type-v q8_0
ggml_cuda_init: found 2 CUDA devices (Total VRAM: 21692 MiB):
Device 0: NVIDIA GeForce RTX 5060 Ti, compute capability 12.0, VMM: yes, VRAM: 15888 MiB
Device 1: NVIDIA GeForce RTX 3060 Laptop GPU, compute capability 8.6, VMM: yes, VRAM: 5803 MiB
| model | size | params | backend | ngl | threads | type_v | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | ------: | -----: | --: | --------------: | -------------------: |
| qwen35 27B Q3_K - Medium | 12.64 GiB | 26.90 B | CUDA | 999 | 12 | q8_0 | 1 | pp512 | 367.28 ± 1.88 |
| qwen35 27B Q3_K - Medium | 12.64 GiB | 26.90 B | CUDA | 999 | 12 | q8_0 | 1 | tg128 | 16.71 ± 0.03 |
