217 12 months ago

q2_k quant

tools
ollama run gbenson/qwen2.5-0.5b-instruct:Q2_K

Applications

Claude Code
Claude Code ollama launch claude --model gbenson/qwen2.5-0.5b-instruct:Q2_K
Codex
Codex ollama launch codex --model gbenson/qwen2.5-0.5b-instruct:Q2_K
OpenCode
OpenCode ollama launch opencode --model gbenson/qwen2.5-0.5b-instruct:Q2_K
OpenClaw
OpenClaw ollama launch openclaw --model gbenson/qwen2.5-0.5b-instruct:Q2_K

Models

View all →

Readme

The model you get when you:
ollama run hf.co/Qwen/Qwen2.5-0.5B-Instruct-GGUF:Q2_K

with the prompt and template you get when you:
ollama run qwen2.5:0.5b

Sources
  1. https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct-GGUF
  2. https://ollama.com/library/qwen2.5:0.5b