reecdev/tiny-oss

reecdev/ tiny-oss

331 Downloads Updated 2 months ago

A variant of gpt-oss designed for consumer hardware

tools thinking e3b

ollama run reecdev/tiny-oss

curl http://localhost:11434/api/chat \
  -d '{
    "model": "reecdev/tiny-oss",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='reecdev/tiny-oss',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'reecdev/tiny-oss',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Applications

Claude Code ollama launch claude --model reecdev/tiny-oss

Codex App ollama launch codex-app --model reecdev/tiny-oss

OpenClaw ollama launch openclaw --model reecdev/tiny-oss

Hermes Agent ollama launch hermes --model reecdev/tiny-oss

Codex ollama launch codex --model reecdev/tiny-oss

OpenCode ollama launch opencode --model reecdev/tiny-oss

Models

View all →

Name

2 models

Size / Usage

Context

Input

tiny-oss:latest

3.6GB · 128K context window · Text · 2 months ago

tiny-oss:latest

3.6GB

128K

Text

tiny-oss:e3b

3.6GB · 128K context window · Text · 2 months ago

tiny-oss:e3b

3.6GB

128K

Text

Readme

tiny-oss

tiny-oss is a derivative of gpt-oss designed for consumer hardware. With 6 billion total parameters compressed, it is able to run on consumer GPUs with less than 4 GB of VRAM!

Why?

The original gpt-oss is too heavy for most consumer devices. tiny-oss is a derivative of gpt-oss that uses compression techniques such as expert pruning and optimized quantization to compress gpt-oss into only 6 billion parameters.

Quick Start

Run tiny-oss with ollama:

ollama run reecdev/tiny-oss

Compare models:

ollama run reecdev/tiny-oss --verbose Solve 1 + 1. && ollama run gpt-oss:20b --verbose Solve 1 + 1.