20 3 days ago

Initially built this 7b model to fit in my RTX 4060 with 8GB

tools
ollama run michaelmontuori/Qwen2.5-7B-Instruct-GGUF:Q4_K_M-32k

Applications

Claude Code
Claude Code ollama launch claude --model michaelmontuori/Qwen2.5-7B-Instruct-GGUF:Q4_K_M-32k
OpenCode
OpenCode ollama launch opencode --model michaelmontuori/Qwen2.5-7B-Instruct-GGUF:Q4_K_M-32k
Hermes Agent
Hermes Agent ollama launch hermes --model michaelmontuori/Qwen2.5-7B-Instruct-GGUF:Q4_K_M-32k
OpenClaw
OpenClaw ollama launch openclaw --model michaelmontuori/Qwen2.5-7B-Instruct-GGUF:Q4_K_M-32k

Models

View all →

Readme

michaelmontuori/Qwen2.5-7B-Instruct-GGUF:Q4_K_M-32k is built to fit RTX 4060 with 8GB of VRAM