oamazonasgabriel/ qwen3.5-0.8b

21 Downloads Updated 3 days ago

Qwen3.5 0.8B in Q8_0 quantization. Small, fast model with 262K context, vision, tool use, and thinking capabilities. Optimized for local/edge deployment on constrained hardware.

vision tools thinking

ollama run oamazonasgabriel/qwen3.5-0.8b:q8-8gbGPU

curl http://localhost:11434/api/chat \
  -d '{
    "model": "oamazonasgabriel/qwen3.5-0.8b:q8-8gbGPU",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='oamazonasgabriel/qwen3.5-0.8b:q8-8gbGPU',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'oamazonasgabriel/qwen3.5-0.8b:q8-8gbGPU',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Applications

Claude Code

Claude Code ollama launch claude --model oamazonasgabriel/qwen3.5-0.8b:q8-8gbGPU

Codex App

Codex App ollama launch codex-app --model oamazonasgabriel/qwen3.5-0.8b:q8-8gbGPU

OpenClaw

OpenClaw ollama launch openclaw --model oamazonasgabriel/qwen3.5-0.8b:q8-8gbGPU

Hermes Agent

Hermes Agent ollama launch hermes --model oamazonasgabriel/qwen3.5-0.8b:q8-8gbGPU

Codex

Codex ollama launch codex --model oamazonasgabriel/qwen3.5-0.8b:q8-8gbGPU

OpenCode

OpenCode ollama launch opencode --model oamazonasgabriel/qwen3.5-0.8b:q8-8gbGPU

Models

Name

1 model

Size / Usage

Context

Input

qwen3.5-0.8b:q8-8gbGPU

1.0GB · 256K context window · Text, Image · 3 days ago

qwen3.5-0.8b:q8-8gbGPU

1.0GB

256K

Text, Image

Readme

Qwen3.5 0.8B - Q8_0 Quantization

A lightweight Qwen3.5 0.8B parameter model in Q8_0 quantization, optimized for local and edge deployment on constrained hardware.

Model Details

Property	Value
Architecture	Qwen3.5
Parameters	873M
Quantization	Q8_0
Context Length	262,144
Embedding Length	1,024
License	Apache 2.0

Capabilities

Completion ‚Äî General text generation
Vision ‚Äî Multimodal image understanding
Tool Use ‚Äî Function calling support
Thinking ‚Äî Chain-of-thought reasoning

Parameters

temperature = 1
top_k = 20
top_p = 0.95
presence_penalty = 1.5

Usage

ollama pull oamazonasgabriel/qwen3.5-0.8b:q8-8gbGPU
ollama run oamazonasgabriel/qwen3.5-0.8b:q8-8gbGPU

When to Use

Edge devices with limited memory
Quick prototyping and experimentation
Tasks where latency matters more than accuracy
As a Draft Model for speculative decoding with larger Qwen3.5 variants

Limitations

Small parameter count limits complex reasoning and instruction following
Not suitable for tasks requiring deep domain expertise
Vision capabilities are basic compared to larger multimodal models

# Qwen3.5 0.8B - Q8_0 Quantization

A lightweight Qwen3.5 0.8B parameter model in Q8_0 quantization, optimized for local and edge deployment on constrained hardware.

## Model Details

| Property | Value |
|---|---|
| Architecture | Qwen3.5 |
| Parameters | 873M |
| Quantization | Q8_0 |
| Context Length | 262,144 |
| Embedding Length | 1,024 |
| License | Apache 2.0 |

## Capabilities

- **Completion** ‚Äî General text generation
- **Vision** ‚Äî Multimodal image understanding
- **Tool Use** ‚Äî Function calling support
- **Thinking** ‚Äî Chain-of-thought reasoning

## Parameters

```
temperature = 1
top_k = 20
top_p = 0.95
presence_penalty = 1.5
```

## Usage

```bash
ollama pull oamazonasgabriel/qwen3.5-0.8b:q8-8gbGPU
ollama run oamazonasgabriel/qwen3.5-0.8b:q8-8gbGPU
```

## When to Use

- Edge devices with limited memory
- Quick prototyping and experimentation
- Tasks where latency matters more than accuracy
- As a Draft Model for speculative decoding with larger Qwen3.5 variants

## Limitations

- Small parameter count limits complex reasoning and instruction following
- Not suitable for tasks requiring deep domain expertise
- Vision capabilities are basic compared to larger multimodal models

Paste, drop or click to upload images (.png, .jpeg, .jpg, .svg, .gif)