oamazonasgabriel/ qwen3.5-2b:q8-8gbGPU

37 Downloads Updated 3 days ago

Qwen3.5 2B in Q8_0 quantization. Strong balance of capability and efficiency with 262K context, vision, tool use, and thinking. Ideal for local deployment on consumer hardware.

vision tools thinking

ollama run oamazonasgabriel/qwen3.5-2b:q8-8gbGPU

curl http://localhost:11434/api/chat \
  -d '{
    "model": "oamazonasgabriel/qwen3.5-2b:q8-8gbGPU",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='oamazonasgabriel/qwen3.5-2b:q8-8gbGPU',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'oamazonasgabriel/qwen3.5-2b:q8-8gbGPU',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 3 days ago

3 days ago

324d162be6ca · 2.7GB ·

model

archqwen35

·

parameters2.27B

·

quantizationQ8_0

2.7GB

license

Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

11kB

params

{ "presence_penalty": 1.5, "temperature": 1, "top_k": 20, "top_p": 0.95 }

65B

Readme

Qwen3.5 2B - Q8_0 Quantization

A balanced Qwen3.5 2B parameter model in Q8_0 quantization, offering strong reasoning and multimodal capabilities while remaining lightweight enough for local consumer hardware.

Model Details

Property	Value
Architecture	Qwen3.5
Parameters	2.3B
Quantization	Q8_0
Context Length	262,144
Embedding Length	2,048
License	Apache 2.0

Capabilities

Completion ‚Äî General text generation
Vision ‚Äî Multimodal image understanding
Tool Use ‚Äî Function calling support
Thinking ‚Äî Chain-of-thought reasoning

Parameters

temperature = 1
top_k = 20
top_p = 0.95
presence_penalty = 1.5

Usage

ollama pull oamazonasgabriel/qwen3.5-2b:q8-8gbGPU
ollama run oamazonasgabriel/qwen3.5-2b:q8-8gbGPU

When to Use

Local deployment on laptops and desktops with limited VRAM
Assistant workloads needing tool use and reasoning
Multimodal tasks combining text and images
As a Draft Model for speculative decoding with larger Qwen3.5 variants

Limitations

May struggle with highly complex or multi-step reasoning tasks
Vision capabilities are limited compared to larger multimodal models
Not recommended for production workloads requiring high reliability

# Qwen3.5 2B - Q8_0 Quantization

A balanced Qwen3.5 2B parameter model in Q8_0 quantization, offering strong reasoning and multimodal capabilities while remaining lightweight enough for local consumer hardware.

## Model Details

| Property | Value |
|---|---|
| Architecture | Qwen3.5 |
| Parameters | 2.3B |
| Quantization | Q8_0 |
| Context Length | 262,144 |
| Embedding Length | 2,048 |
| License | Apache 2.0 |

## Capabilities

- **Completion** ‚Äî General text generation
- **Vision** ‚Äî Multimodal image understanding
- **Tool Use** ‚Äî Function calling support
- **Thinking** ‚Äî Chain-of-thought reasoning

## Parameters

```
temperature = 1
top_k = 20
top_p = 0.95
presence_penalty = 1.5
```

## Usage

```bash
ollama pull oamazonasgabriel/qwen3.5-2b:q8-8gbGPU
ollama run oamazonasgabriel/qwen3.5-2b:q8-8gbGPU
```

## When to Use

- Local deployment on laptops and desktops with limited VRAM
- Assistant workloads needing tool use and reasoning
- Multimodal tasks combining text and images
- As a Draft Model for speculative decoding with larger Qwen3.5 variants

## Limitations

- May struggle with highly complex or multi-step reasoning tasks
- Vision capabilities are limited compared to larger multimodal models
- Not recommended for production workloads requiring high reliability

Paste, drop or click to upload images (.png, .jpeg, .jpg, .svg, .gif)