<![CDATA[Modèle à tester : ShayanCyan/phi4-multimodal-quantisized-gguf]]>https://huggingface.co/asuglia/Qwen2-VL-2B-Instruct-Q4_K_M-GGUF => Non.

Link Preview Image
unsloth/Qwen3-VL-8B-Thinking-GGUF · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

favicon

(huggingface.co)

Link Preview Image
ShayanCyan/phi4-multimodal-quantisized-gguf at main

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

favicon

(huggingface.co)

]]>https://lemmy.cyber-neurones.org/topic/405/modèle-à-tester-shayancyan-phi4-multimodal-quantisized-ggufRSS for NodeThu, 01 Oct 2026 22:54:45 GMTMon, 28 Sep 2026 09:37:17 GMT60<![CDATA[Reply to Modèle à tester : ShayanCyan/phi4-multimodal-quantisized-gguf on Wed, 30 Sep 2026 15:03:29 GMT]]>A tester : https://huggingface.co/LiquidAI/LFM2.5-VL-3B-GGUF/tree/main

Chargement :

https://huggingface.co/LiquidAI/LFM2.5-VL-3B-GGUF/blob/main/LFM2.5-VL-3B-Q8_0.gguf
https://huggingface.co/LiquidAI/LFM2.5-VL-3B-GGUF/blob/main/mmproj-LFM2.5-VL-3B-Q8_0.gguf

]]>https://lemmy.cyber-neurones.org/post/1296https://lemmy.cyber-neurones.org/post/1296Wed, 30 Sep 2026 15:03:29 GMT<![CDATA[Reply to Modèle à tester : ShayanCyan/phi4-multimodal-quantisized-gguf on Tue, 29 Sep 2026 14:44:28 GMT]]>Reduction de la mémoire pour que cela puisse se lancer :

  "Best_phi4-mm-Q4_K_M.gguf_mmproj-vision-q8.gguf":
   proxy: http://127.0.0.1:8998
   capabilities:
     context: 100000
   name: "Best_phi4-mm-Q4_K_M"
   description: "-m /models/phi4-mm-Q4_K_M.gguf --mmproj /models/phi4-mm-vision-q8.gguf --ctx-size ${default_ctx} --temp ${temp} --top-p 0.95 --top-k 40 --min-p 0.05 --host 0.0.0.0 --fit off -ngl 40 --port 8998"
   cmd: /usr/local/bin/llama-server -m /models/phi4-mm-Q4_K_M.gguf --mmproj /models/phi4-mm-vision-q8.gguf --ctx-size ${default_ctx} --temp ${temp} --top-p 0.95 --top-k 40 --min-p 0.05 --host 0.0.0.0 --fit off -ngl 40 --port 8998 -fa on --flash-attn on --n-cpu-moe 25
   aliases:
     - "best-phi4-mm"
     - "llama-swap-phi4"
   macros:
     "default_ctx": 100000
     "temp": 0.7
   metadata:
     temperature: ${temp}
     note: "The ${MODEL_ID} is running on port 8998 temp=${temp}, context=${default_ctx}"
   env:
     - "NVM_BIN=/root/.nvm/versions/node/v24.17.0/bin"
     - "NVM_DIR=/root/.nvm"
     - "NVM_INC=/root/.nvm/versions/node/v24.17.0/include/node"
     - "PATH=/root/.nvm/versions/node/v24.17.0/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
     - "CUDA_DEVICE_ORDER=PCI_BUS_ID"
   ttl: 60

image.jpeg

]]>https://lemmy.cyber-neurones.org/post/1293https://lemmy.cyber-neurones.org/post/1293Tue, 29 Sep 2026 14:44:28 GMT<![CDATA[Reply to Modèle à tester : ShayanCyan/phi4-multimodal-quantisized-gguf on Tue, 29 Sep 2026 13:12:58 GMT]]>Configuration :

  "Best_phi4-mm-Q4_K_M.gguf_mmproj-vision-q8.gguf":
   proxy: http://127.0.0.1:8998
   capabilities:
     context: 128000
   name: "Best_phi4-mm-Q4_K_M"
   description: "-m /models/phi4-mm-Q4_K_M.gguf --mmproj /models/phi4-mm-vision-q8.gguf --ctx-size ${default_ctx} --temp ${temp} --top-p 0.95 --top-k 40 --min-p 0.05 --host 0.0.0.0 --fit off -ngl 40 --port 8998"
   cmd: /usr/local/bin/llama-server -m /models/phi4-mm-Q4_K_M.gguf --mmproj /models/phi4-mm-vision-q8.gguf --ctx-size ${default_ctx} --temp ${temp} --top-p 0.95 --top-k 40 --min-p 0.05 --host 0.0.0.0 --fit off -ngl 40 --port 8998 -fa on --flash-attn on
   aliases:
     - "best-phi4-mm"
     - "llama-swap-phi4"
   macros:
     "default_ctx": 128000
     "temp": 0.7
   metadata:
     temperature: ${temp}
     note: "The ${MODEL_ID} is running on port 8998 temp=${temp}, context=${default_ctx}"
   env:
     - "NVM_BIN=/root/.nvm/versions/node/v24.17.0/bin"
     - "NVM_DIR=/root/.nvm"
     - "NVM_INC=/root/.nvm/versions/node/v24.17.0/include/node"
     - "PATH=/root/.nvm/versions/node/v24.17.0/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
     - "CUDA_DEVICE_ORDER=PCI_BUS_ID"
   ttl: 60
]]>https://lemmy.cyber-neurones.org/post/1292https://lemmy.cyber-neurones.org/post/1292Tue, 29 Sep 2026 13:12:58 GMT