huihui_ai/deepseek-r1:671b-q2

huihui_ai/ deepseek-r1:671b-q2_K

187 Downloads Updated 7 months ago

DeepSeek's first-generation of reasoning models with comparable performance to OpenAI-o1, including six dense models distilled from DeepSeek-R1 based on Llama and Qwen.

thinking 671b

ollama run huihui_ai/deepseek-r1:671b-q2_K

curl http://localhost:11434/api/chat \
  -d '{
    "model": "huihui_ai/deepseek-r1:671b-q2_K",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='huihui_ai/deepseek-r1:671b-q2_K',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'huihui_ai/deepseek-r1:671b-q2_K',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 11 months ago

11 months ago

93f8490a2eb1 · 244GB ·

model

archdeepseek2

parameters671B

quantizationQ2_K

244GB

license

1.1kB

params

{ "stop": [ "<｜begin▁of▁sentence｜>", "<｜end▁of▁sentence｜>",

148B

template

{{- if .System }}{{ .System }}{{ end }} {{- range $i, $_ := .Messages }} {{- $last := eq (len (slice

387B

Readme

Note: this model requires Ollama 0.9 or later.

Before running the instruction, please set the num_thread to half of your current CPU thread count, otherwise it may slow down your computer. Here is an example:

/set parameter num_thread 32