fredrezones55/ Qwen3.5-APEX:mini

542 1 month ago

Qwen3.5-35B-A3B APEX GGUF -- A Novel MoE-Aware Mixed-Precision Quantization Technique Brought to you by the LocalAI team -- the creators of LocalAI the open-source AI engine that runs any model - LLMs, vision, image - on any hardware.

vision tools thinking
... /
params
9371364b27a5 · 65B
{
"presence_penalty": 1.5,
"temperature": 1,
"top_k": 20,
"top_p": 0.95
}