53 1 year ago

r1-0528 unsloth quants

tools thinking 671b
ollama run dset/deepseek-r1-0528-tools

Applications

Claude Code
Claude Code ollama launch claude --model dset/deepseek-r1-0528-tools
Codex App
Codex App ollama launch codex-app --model dset/deepseek-r1-0528-tools
OpenClaw
OpenClaw ollama launch openclaw --model dset/deepseek-r1-0528-tools
Hermes Agent
Hermes Agent ollama launch hermes --model dset/deepseek-r1-0528-tools
Codex
Codex ollama launch codex --model dset/deepseek-r1-0528-tools
OpenCode
OpenCode ollama launch opencode --model dset/deepseek-r1-0528-tools

Models

View all →

Readme

from unsloth quants: https://huggingface.co/unsloth/DeepSeek-V3-0324-GGUF

screwed around with the template until reasoning and tool calls worked 1 time

do not expect this to work