frob/nex-n2-mini:35b-a3b-q8

frob/ nex-n2-mini:35b-a3b-q8_0

71 Downloads Updated 1 month ago

tools thinking 35b

ollama run frob/nex-n2-mini:35b-a3b-q8_0

curl http://localhost:11434/api/chat \
  -d '{
    "model": "frob/nex-n2-mini:35b-a3b-q8_0",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='frob/nex-n2-mini:35b-a3b-q8_0',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'frob/nex-n2-mini:35b-a3b-q8_0',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 2 months ago

2 months ago

aa3a15473ab5 · 37GB

model

archqwen35moe

parameters34.7B

quantizationQ8_0

37GB

license

Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

10kB

params

{ "temperature": 0.7, "top_k": 40, "top_p": 0.95 }

44B

Readme

Imported from https://huggingface.co/bartowski/nex-agi_Nex-N2-Mini-GGUF

$ ollama run frob/nex-n2-mini hello
Thinking...
We need answer to user "hello". Need be friendly. Also system says API, no reveal. We can say hi. final? Since assistant response should be in final maybe. Use final only.
...done thinking.

Hello! How can I help you today?

$ ollama run frob/nex-n2-mini hello --think=false
Hello! How can I help?

$ ollama launch opencode \
    --model frob/nex-n2-mini \
    -- \
    run "Create a manifest (manifest.md) file that lists all of the entries in the current directory."

> build · frob/nex-n2-mini:latest

→ Read .

← Write manifest.md
Wrote file successfully.

Created `/tank/ai/models/hf.co/bartowski/nex-agi_Nex-N2-Mini-GGUF/manifest.md`.

$ cat manifest.md 
## Current Directory Entries

- .cache/
- nex-agi_Nex-N2-mini-bf16/
- nex-agi_Nex-N2-mini-Q4_K_M.gguf
- nex-agi_Nex-N2-mini-Q6_K_L.gguf
- nex-agi_Nex-N2-mini-Q6_K.gguf
- nex-agi_Nex-N2-mini-Q8_0.gguf