frob/nex-n2-mini:35b-a3b

frob/ nex-n2-mini:35b-a3b

71 Downloads Updated 1 month ago

tools thinking 35b

ollama run frob/nex-n2-mini:35b-a3b

curl http://localhost:11434/api/chat \
  -d '{
    "model": "frob/nex-n2-mini:35b-a3b",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='frob/nex-n2-mini:35b-a3b',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'frob/nex-n2-mini:35b-a3b',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 month ago

1 month ago

221f5c7724ec · 21GB

model

archqwen35moe

parameters34.7B

quantizationQ4_K_M

21GB

license

Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

10kB

params

{ "temperature": 0.7, "top_k": 40, "top_p": 0.95 }

44B

Readme

Imported from https://huggingface.co/bartowski/nex-agi_Nex-N2-Mini-GGUF

$ ollama run frob/nex-n2-mini hello
Thinking...
We need answer to user "hello". Need be friendly. Also system says API, no reveal. We can say hi. final? Since assistant response should be in final maybe. Use final only.
...done thinking.

Hello! How can I help you today?

$ ollama run frob/nex-n2-mini hello --think=false
Hello! How can I help?

$ ollama launch opencode \
    --model frob/nex-n2-mini \
    -- \
    run "Create a manifest (manifest.md) file that lists all of the entries in the current directory."

> build · frob/nex-n2-mini:latest

→ Read .

← Write manifest.md
Wrote file successfully.

Created `/tank/ai/models/hf.co/bartowski/nex-agi_Nex-N2-Mini-GGUF/manifest.md`.

$ cat manifest.md 
## Current Directory Entries

- .cache/
- nex-agi_Nex-N2-mini-bf16/
- nex-agi_Nex-N2-mini-Q4_K_M.gguf
- nex-agi_Nex-N2-mini-Q6_K_L.gguf
- nex-agi_Nex-N2-mini-Q6_K.gguf
- nex-agi_Nex-N2-mini-Q8_0.gguf