dset/
deepseek-r1-0528-tools:latest

46 6 months ago

r1-0528 unsloth quants

tools thinking 671b

6 months ago

99926729d9ad · 251GB ·

model
deepseek2
·
671B
·
Q2_K
params
{ "num_ctx": 4096, "stop": [ "<｜begin▁of▁sentence｜>", "<｜end▁of
license
MIT License Copyright (c) 2023 DeepSeek Permission is hereby granted, free of charge, to any person
template
{{- if .Messages }} {{- if or .System .Tools }} {{- if .System }} {{ .System }} {{- end }} {{- if .T

Readme

from unsloth quants: https://huggingface.co/unsloth/DeepSeek-V3-0324-GGUF

screwed around with the template until reasoning and tool calls worked 1 time

do not expect this to work