isotnek/Nanbeige4.1-3B-heretic

isotnek/ Nanbeige4.1-3B-heretic

14 Downloads Updated 5 days ago

Ollama version of de-censored Nanbeige4.1-3B-heretic

ollama run isotnek/Nanbeige4.1-3B-heretic

curl http://localhost:11434/api/chat \
  -d '{
    "model": "isotnek/Nanbeige4.1-3B-heretic",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='isotnek/Nanbeige4.1-3B-heretic',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'isotnek/Nanbeige4.1-3B-heretic',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Models

View all →

Name

1 model

Size

Context

Input

Nanbeige4.1-3B-heretic:latest

4.2GB · 256K context window · Text · 5 days ago

Nanbeige4.1-3B-heretic:latest

4.2GB

256K

Text

Readme

heretic-org/Nanbeige4.1-3B-heretic adapted for Ollama.

The original technical report for the model can be found here.

Warning: This model is prone to overthinking and may take a while to arrive at a response to even very simple questions. However, those responses seem pretty good for a model of this size. Inference-time scaling for the win!