haervwe/ GLM-4.6V-Flash-9B:latest

745 1 month ago

GLM 4.6V Flash 9B model with vision, tools, and hybrid thinking enabled. using custom template to align it to ollama and the recomended sampling settigns by default. using unsloth quants at q4K_M

vision tools thinking
... /
params
0bfbf1cdcce2 · 179B
{
"num_ctx": 65556,
"repeat_penalty": 1.1,
"stop": [
"<|system|>",
"<|user|>",
"<|assistant|>",
"<|user|>"
],
"temperature": 0.8,
"top_k": 2,
"top_p": 0.6
}