181 3 months ago

Qwen3:235b Thinking 2507 - Unsloth Dynamic 2.0 (Q3 K XL) Edit

tools thinking

Models

View all →

Readme

Merged gguf files from Unsloth’s Thinking Q3_K_XL using the default Qwen3:255b modelfile with the recommended settings from Qwen, slightly updated by the temperature and top_p defaults recommended by Unsloth (close to the end of the page).

Find the non-thinking model here.

Qwen Banner

Unsloth Sticker

Performance on an Apple M4 Max 128GB

The performance seems to be comparable to the non-thinking model, please see the details here