181 3 months ago

Qwen3:235b Thinking 2507 - Unsloth Dynamic 2.0 (Q3 K XL) Edit

tools thinking

3 months ago

0a166b05e0a4 · 103GB ·

qwen3moe
·
235B
·
Q3_K_M
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
{ "repeat_penalty": 1, "stop": [ "<|im_start|>", "<|im_end|>" ], "te
{{- $lastUserIdx := -1 -}} {{- range $idx, $msg := .Messages -}} {{- if eq $msg.Role "user" }}{{ $la

Readme

Merged gguf files from Unsloth’s Thinking Q3_K_XL using the default Qwen3:255b modelfile with the recommended settings from Qwen, slightly updated by the temperature and top_p defaults recommended by Unsloth (close to the end of the page).

Find the non-thinking model here.

Qwen Banner

Unsloth Sticker

Performance on an Apple M4 Max 128GB

The performance seems to be comparable to the non-thinking model, please see the details here