Imported from https://hf.co/unsloth/Kimi-K3-GGUF/.

This model is currently text-only. Vision support pending.

Needs ollama 0.32.15+.

Chat/thinking

Note that the ollama client claims that the model does not support thinking. This is incorrect, the ollama capabilities detection is incomplete.

$ ollama run frob/kimi-k3 
>>> hello
Thinking...
The user just said "hello" - a simple greeting. This is an extremely simple
conversational opener with no complex content to analyze.

Let me think about what the appropriate response format should be. The
guidelines are clear:
- Casual conversation should get short responses
- Greetings shouldn't be met with long formatted responses
- I shouldn't pad responses with unnecessary content
- "Hello" is a simple greeting that deserves a simple, warm greeting back

I should:
1. Greet them back warmly
2. Perhaps offer to help, but keep it brief
3. Not use bullet points, headers, or any markdown formatting
4. Keep it conversational and natural

A good response would be something like "Hello! How can I help you today?"
or something similarly brief and friendly. I shouldn't over-explain or write
paragraphs. Just a natural,  warm greeting that opens the door for them to
share what they'd like help with.

Format check: This should be very short - one or two sentences max. No headers,
no bullets, no lists. Just conversational text.
...done thinking.

Hello! How can I help you today?

>>> /clear
Cleared session context
>>> /set nothink
warning: model "frob/kimi-k3" does not support thinking output
Set 'nothink' mode.
>>> hello
Hello! Nice to meet you. I'm Kimi, and I'm here to help with whatever you 
need—whether that's answering questions, helping with writing, brainstorming 
ideas, coding assistance, or just having a conversation.

What can I do for you today?

Tools

$ ollama launch opencode \
    --model frob/kimi-k3 \
    -- \
    run 'create a file called README with the contents "hello world"'

> build · frob/kimi-k3:latest

← Write README
Wrote file successfully.

Created `/home/rick/ollama/issues/kimi-k3/README` with contents `hello world`.

$ cat README 
hello world