46 6 months ago

r1-0528 unsloth quants

tools thinking 671b

Models

View all →

Readme

from unsloth quants: https://huggingface.co/unsloth/DeepSeek-V3-0324-GGUF

screwed around with the template until reasoning and tool calls worked 1 time

do not expect this to work