179 Downloads Updated 6 days ago
ollama run tobestyledintro/oxcoder-9b:q5_k_m
Updated 6 days ago
6 days ago
61be232e55d3 · 7.4GB
Vision · Tools · Thinking · 262K context · Apache-2.0
OxCoder-9B is a lightweight coding model built for long-horizon tasks, agentic coding and agentic reasoning. It punches far above its weight class: at 9B parameters it rivals much larger models on agentic terminal and coding benchmarks.
It was distilled from frontier agent traces (Fable-5.1 and GLM-5.3 agentic coding trajectories across Claude Code, OpenCode and Codex), which gives it behaviours that matter in real iterative coding: read-before-write patterns, reacting to LSP diagnostics, and applying minimal edit diffs instead of full rewrites. It also shows unusually strong front-end reasoning for its size (UI logic, component architecture, web-native patterns).
Original model by OrionLLM · GGUF quants and vision projector by prithivMLmods · base model Qwen/Qwen3.5-9B · this Ollama packaging is a community repack, all credit to OrionLLM.
| Tag | Quant | Size | Notes |
|---|---|---|---|
latest |
Q4_K_M | 6.5 GB | best size/quality compromise (incl. 0.9 GB vision projector) |
q5_k_m |
Q5_K_M | 7.4 GB | higher quality, same footprint class |
ollama run tobestyledintro/oxcoder-9b # latest = Q4_K_M
ollama run tobestyledintro/oxcoder-9b:q5_k_m
# chat / code
ollama run tobestyledintro/oxcoder-9b
# whole-repo work (native 262144 context)
ollama run tobestyledintro/oxcoder-9b --ctx 262144
# vision (screenshots, mockups, diagrams)
ollama run tobestyledintro/oxcoder-9b "Recreate this UI as HTML/Tailwind: ./mockup.png"
API:
curl http://localhost:11434/api/chat -d '{
"model": "tobestyledintro/oxcoder-9b",
"messages": [{"role": "user", "content": "Refactor this function to be iterative."}]
}'
Tool calling (native, structured tool_calls — useful for agent harnesses):
tools = [{"type": "function", "function": {
"name": "read_file",
"description": "Read a file from disk",
"parameters": {"type": "object", "properties": {"path": {"type": "string"}}, "required": ["path"]}}}]
r = ollama.chat(model='tobestyledintro/oxcoder-9b',
messages=[{'role': 'user', 'content': 'Open src/main.py'}],
tools=tools)
print(r.message.tool_calls)
tool_calls (no XML parsing).This package ships with temperature=0.6, top_p=0.95, top_k=20.
Note the author’s own benchmark settings: agentic evaluations (Terminal-Bench 2.1, NL2Repo) use temperature=1.0, top_p=1.0; ClawEval uses temperature=0.6. If you drive it as a coding agent, raising the temperature toward 1.0 matches the way it was evaluated.
Measured on 1× RTX 5090 (32 GB), Q4_K_M fully offloaded:
| short factual answer | 139 tok/s |
| Python code generation | 125–130 tok/s |
| tool call | structured tool_calls, correct arguments |
| vision | reads text from an image correctly |
| architecture | qwen3_5 (Qwen3_5ForConditionalGeneration) |
| parameters | 9B dense |
| layers | 32 |
| context | 262144 |
| vision | clip, depth 27, hidden 1152, projection 4096 |
| quantization | Q4_K_M / Q5_K_M (upstream GGUF, unmodified weights) |