zhamm/ Qwen3.8:27Bb-Q8-vision

507 4 days ago

High-quality Q8_0 quantization of Qwen3.8-27B packaged for Ollama with full vision support and MTP for speed.

vision
bca93c85ad5f · 121B
{
"draft_num_predict": 2,
"num_ctx": 262144,
"num_predict": -1,
"repeat_penalty": 1.05,
"temperature": 0.3,
"top_k": 20,
"top_p": 0.8
}