139 2 months ago

qwen3 next 80b-A3B instruct q4

ollama run B-A-M-N/qwen3-next-instruct-q4

Details

2 months ago

85b0f234f7d6 · 45GB ·

qwen3next
·
79.7B
·
Q4_0
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user
You are Qwen3-Next, a large language model developed by Alibaba Cloud. You are helpful, harmless, an
{ "min_p": 0, "presence_penalty": 1, "stop": [ "<|im_start|>", "<|im_end

Readme

this requires a minimum of 53-56gb ram to run.