673 Downloads Updated 3 weeks ago
ollama run turintech/kev-4b-artemis
Name
7 models
kev-4b-artemis:latest
2.5GB · 256K context window · Text · 3 weeks ago
kev-4b-artemis:2.0gb
2.0GB · 256K context window · Text · 3 weeks ago
kev-4b-artemis:2.2gb
2.2GB · 256K context window · Text · 3 weeks ago
kev-4b-artemis:2.5gb
latest2.5GB · 256K context window · Text · 3 weeks ago
kev-4b-artemis:iq3_m
2.2GB · 256K context window · Text · 3 weeks ago
kev-4b-artemis:q3_k_m
2.0GB · 256K context window · Text · 3 weeks ago
kev-4b-artemis:q4_k_m
2.5GB · 256K context window · Text · 3 weeks ago
Kev-4B for routing, triage and quick checks on your own GPU. It answers typed questions (yes or no, pick one, a score) with a probability for each answer, in one pass.
Kev-4B-Artemis-Q4_K_M.gguf.echo "My Stripe integration keeps failing. Please help ASAP." | ollama run turintech/kev-4b-artemis:2.5gb --ask "Does this message express urgency?"
Kev-4B is a 4B decision model by Jared Palmer.
Ollama serves /v1/systemone with a model field added.
curl http://localhost:11434/v1/systemone -d '{
"model": "turintech/kev-4b-artemis:2.5gb",
"state": "My Stripe integration keeps failing. Please help ASAP.",
"questions": {"urgency": {"type": "noul", "instructions": "Does this message express urgency?"}}
}'
The package sets num_ctx 16384 and num_batch 4096, the card’s llama-server settings (-c 16384 -ub 4096 -b 4096). The batch size moves the probabilities slightly, so keep it when you compare with the card.
Our default file against the closest public file and the original, on 2,000 typed decisions from the test split. These decisions were also used to choose the file.
| File | Size | Same answer as original | Confident answers changed | Accuracy |
|---|---|---|---|---|
| Ours, Q4_K_M | 2.54 GB | 93.0% | 0 | 66.8% |
| ggml-org Q4_K_M | 3.03 GB | 93.2% | 0 | 66.8% |
| BF16 original | 8.43 GB | reference | reference | 66.8% |
The public Q4_K_M is larger but stays closer to the original on the 1,000 train-split decisions (94.0% against 92.7%). How it was tested.
Every file we publish for this model. Sizes are download sizes, not memory.
| File | Size | Use it for | Ollama tag |
|---|---|---|---|
Kev-4B-Artemis-Q4_K_M.gguf |
2.54 GB | Default | q4_k_m (latest) |
Kev-4B-Artemis-IQ3_M.gguf |
2.17 GB | Smaller: a little less memory | iq3_m |
Kev-4B-Artemis-Q3_K_M.gguf |
2.04 GB | Smaller: tight memory; about 2 to 3 points lower accuracy | q3_k_m |
ollama run turintech/kev-4b-artemis:<tag>.Apache-2.0, the same as jaredpalmer/kev-4b. The package carries the licence and TurinTech’s NOTICE; the Hugging Face repository has both files.