frob/nex-n2-mini:35b-a3b-Q6

frob/ nex-n2-mini:35b-a3b-Q6_K

31 Downloads Updated yesterday

tools thinking 35b

ollama run frob/nex-n2-mini:35b-a3b-Q6_K

curl http://localhost:11434/api/chat \
  -d '{
    "model": "frob/nex-n2-mini:35b-a3b-Q6_K",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='frob/nex-n2-mini:35b-a3b-Q6_K',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'frob/nex-n2-mini:35b-a3b-Q6_K',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 3 weeks ago

3 weeks ago

24ecfa267890 · 30GB ·

model

archqwen35moe

parameters34.7B

quantizationQ6_K

30GB

license

Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

10kB

params

{ "temperature": 0.7, "top_k": 40, "top_p": 0.95 }

44B

Readme

Imported from https://huggingface.co/bartowski/nex-agi_Nex-N2-Mini-GGUF

$ ollama run frob/nex-n2-mini hello
Thinking...
We need answer to user "hello". Need be friendly. Also system says API, no reveal. We can say hi. final? Since assistant response should be in final maybe. Use final only.
...done thinking.

Hello! How can I help you today?

$ ollama run frob/nex-n2-mini hello --think=false
Hello! How can I help?

$ ollama launch opencode \
    --model frob/nex-n2-mini \
    -- \
    run "Create a manifest (manifest.md) file that lists all of the entries in the current directory."

> build · frob/nex-n2-mini:latest

→ Read .

← Write manifest.md
Wrote file successfully.

Created `/tank/ai/models/hf.co/bartowski/nex-agi_Nex-N2-Mini-GGUF/manifest.md`.

$ cat manifest.md 
## Current Directory Entries

- .cache/
- nex-agi_Nex-N2-mini-bf16/
- nex-agi_Nex-N2-mini-Q4_K_M.gguf
- nex-agi_Nex-N2-mini-Q6_K_L.gguf
- nex-agi_Nex-N2-mini-Q6_K.gguf
- nex-agi_Nex-N2-mini-Q8_0.gguf