radenadri/Qwen3.5-0.8B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

radenadri/ Qwen3.5-0.8B-Claude-4.6-Opus-Reasoning-Distilled-GGUF:latest

1,746 Downloads Updated 3 months ago

A lightweight but surprisingly capable reasoning model — distilled from Claude 4.6 Opus, quantized to Q4_K_M for local use.

ollama run radenadri/Qwen3.5-0.8B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

curl http://localhost:11434/api/chat \
  -d '{
    "model": "radenadri/Qwen3.5-0.8B-Claude-4.6-Opus-Reasoning-Distilled-GGUF",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='radenadri/Qwen3.5-0.8B-Claude-4.6-Opus-Reasoning-Distilled-GGUF',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'radenadri/Qwen3.5-0.8B-Claude-4.6-Opus-Reasoning-Distilled-GGUF',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 3 months ago

3 months ago

6e333d63d0fe · 527MB ·

model

archqwen35

parameters752M

quantizationQ4_K_M

527MB

template

<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

114B

system

You are a helpful reasoning assistant that thinks step by step before answering.

80B

params

{ "repeat_penalty": 1.1, "temperature": 0.6, "top_p": 0.95 }

54B

Readme

This is a GGUF quantization of Qwen3.5-0.8B, enhanced through Chain-of-Thought (CoT) distillation from Claude-4.6 Opus. It is designed to deliver superior reasoning capabilities in a compact, ultra-efficient 0.8B parameter package.

https://huggingface.co/Jackrong/Qwen3.5-0.8B-Claude-4.6-Opus-Reasoning-Distilled-GGUF