frozenlab/ qwen3.8-mtp:27b

69 Downloads Updated 1 month ago

vision tools thinking 27b

ollama run frozenlab/qwen3.8-mtp:27b

curl http://localhost:11434/api/chat \
  -d '{
    "model": "frozenlab/qwen3.8-mtp:27b",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='frozenlab/qwen3.8-mtp:27b',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'frozenlab/qwen3.8-mtp:27b',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 month ago

1 month ago

87b2fe0d32bc · 18GB

model

archqwen35

·

parameters27.3B

·

quantizationQ4_K_M

17GB

projector

archclip

·

parameters461M

·

quantizationBF16

931MB

license

Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

11kB

params

{ "draft_num_predict": 2, "min_p": 0.01, "presence_penalty": 0, "repeat_penalty": 1,

117B

Readme

qwen3.8-mtp

Qwen 3.8 27B with a shorter multi-token-prediction (MTP) draft for speculative decoding.

The weights, vision projector, chat template and license are byte-identical to the official qwen3.8:27b. Only the runtime parameters differ:

Parameter	`qwen3.8:27b`	`frozenlab/qwen3.8-mtp`
`draft_num_predict`	4	2
`min_p`	0	0.01

draft_num_predict sets how many tokens the MTP head drafts per step before the main model verifies them. A shorter draft is rejected less often, so less drafted work is thrown away when the text is hard to predict. min_p 0.01 cuts the long tail of very unlikely tokens.

If you already have qwen3.8:27b, pulling this model downloads no new weights.

Model

27.3B parameters, Q4_K_M
Context length: 262,144 tokens
Capabilities: completion, vision, tools, thinking
License: Apache 2.0

Requirements

Ollama 0.32.12 or newer.

Usage

ollama run frozenlab/qwen3.8-mtp:27b

curl http://localhost:11434/api/chat -d '{
  "model": "frozenlab/qwen3.8-mtp:27b",
  "messages": [{ "role": "user", "content": "Hello!" }]
}'

# qwen3.8-mtp

Qwen 3.8 27B with a shorter multi-token-prediction (MTP) draft for speculative decoding.

The weights, vision projector, chat template and license are byte-identical to the official
[`qwen3.8:27b`](https://ollama.com/library/qwen3.8). Only the runtime parameters differ:

| Parameter           | `qwen3.8:27b` | `frozenlab/qwen3.8-mtp` |
|---------------------|---------------|-------------------------|
| `draft_num_predict` | 4             | **2**                   |
| `min_p`             | 0             | **0.01**                |

`draft_num_predict` sets how many tokens the MTP head drafts per step before the main model
verifies them. A shorter draft is rejected less often, so less drafted work is thrown away
when the text is hard to predict. `min_p 0.01` cuts the long tail of very unlikely tokens.

If you already have `qwen3.8:27b`, pulling this model downloads no new weights.

## Model

- 27.3B parameters, Q4_K_M
- Context length: 262,144 tokens
- Capabilities: completion, vision, tools, thinking
- License: Apache 2.0

## Requirements

Ollama **0.32.12** or newer.

## Usage

```bash
ollama run frozenlab/qwen3.8-mtp:27b
```

```bash
curl http://localhost:11434/api/chat -d '{
  "model": "frozenlab/qwen3.8-mtp:27b",
  "messages": [{ "role": "user", "content": "Hello!" }]
}'
```

Paste, drop or click to upload images (.png, .jpeg, .jpg, .svg, .gif)