spooknik/kunoichi-dpo-v2-7b:q8

spooknik/ kunoichi-dpo-v2-7b:q8

1,291 Downloads Updated 2 years ago

SanjiWatsuki’s Kunoichi-DPO-v2-7B

ollama run spooknik/kunoichi-dpo-v2-7b:q8

curl http://localhost:11434/api/chat \
  -d '{
    "model": "spooknik/kunoichi-dpo-v2-7b:q8",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='spooknik/kunoichi-dpo-v2-7b:q8',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'spooknik/kunoichi-dpo-v2-7b:q8',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 2 years ago

2 years ago

3f5b9168d760 · 7.7GB ·

model

archllama

parameters7.24B

quantizationQ8_0

7.7GB

license

Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

12kB

params

{ "stop": [ "USER:", "ASSISTANT:" ] }

32B

template

{{ .System }} USER: {{ .Prompt }} ASSISTANT:

48B

Readme

Original Model | GGUF Quants

SanjiWatsuki’s Kunoichi-DPO-v2-7B. Good quality for a 7B model. Excels in Roleplay.

I strongly recommend the highest quantization you can run. See tags and download the version that suits you best.

Feel free to contact me if you have problems

Reddit: /u/spooknik | Discord: .spooknik