awaescher/qwen3-ud-q3:235b

awaescher/ qwen3-ud-q3:235b

66 Downloads Updated 9 months ago

Qwen3:235b - Unsloth Dynamic 2.0 (Q3 K XL)

tools thinking 235b

ollama run awaescher/qwen3-ud-q3:235b

curl http://localhost:11434/api/chat \
  -d '{
    "model": "awaescher/qwen3-ud-q3:235b",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='awaescher/qwen3-ud-q3:235b',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'awaescher/qwen3-ud-q3:235b',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 9 months ago

9 months ago

74cd611cb97d · 104GB ·

model

archqwen3moe

parameters235B

quantizationQ3_K_M

104GB

license

Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

11kB

params

{ "min_p": 0, "repeat_penalty": 1, "stop": [ "<|im_start|>", "<|im_end|>

130B

template

{{- $lastUserIdx := -1 -}} {{- range $idx, $msg := .Messages -}} {{- if eq $msg.Role "user" }}{{ $la

1.7kB

Readme

Merged gguf files from Unsloth’s Q3_K_XL from Qwen3:255b using the default modelfile with the recommended settings from Qwen.

This model will take about ~110GB VRAM with the default context window of 4096 tokens.