194 1 year ago

(Unsloth Dynamic Quants) DeepSeek's first-generation of reasoning models with comparable performance to OpenAI-o1, 671B MoE full model, not dense distilled models.

ollama run milkey/deepseek-r1-UD:IQ1_M

Details

1 year ago

08d46664e5ce · 169GB ·

deepseek2
·
671B
·
IQ1_S
MIT License Copyright (c) 2023 DeepSeek Permission is hereby granted, free of charge, to any person
{ "stop": [ "<|begin▁of▁sentence|>", "<|end▁of▁sentence|>",
{{- if .System }}{{ .System }}{{ end }} {{- range $i, $_ := .Messages }} {{- $last := eq (len (slice

Readme