oamazonasgabriel/ qwen3.8-27b:q4-km-32gbGPU

16 8 hours ago

Qwen3.8-27B in Q4_K_M quantization (32GB+ VRAM required). Dense 27.8B parameters with hybrid attention for long context (256K tokens). Apache 2.0 license. Ideal for high-VRAM setups (RTX 5090/4090 dual, M4 Ultra, etc.).

... /
params
12c4c8b88fa1 · 111B
{
"num_ctx": 65536,
"num_gpu": 99,
"num_predict": 8192,
"repeat_penalty": 1,
"temperature": 0.7,
"top_k": 40,
"top_p": 0.95
}