68 Downloads Updated 4 hours ago
ollama run turintech/kev-9b-artemis:4.9gb
Updated yesterday
yesterday
2bf2c0814ff3 · 4.9GB
Text-only GGUF files of Kev-9B, a typed decision model. It returns probabilities for allowed answers through /v1/systemone; plain chat is not supported.
TurinTech models, built with Artemis
echo "My Stripe integration keeps failing. Please help ASAP." | ollama run turintech/kev-9b-artemis:iq3_m --ask "Does this message express urgency?"
latest selects iq3_m. The explicit tags below use the same model bytes as the corresponding Hugging Face files. Existing size tags remain available.
| Tag | Hugging Face file | Size |
|---|---|---|
iq3_m (default) |
Kev-9B-Artemis-IQ3_M.gguf |
4.780 GB |
q3_k_s |
Kev-9B-Artemis-Q3_K_S.gguf |
4.070 GB |
q3_k_l |
Kev-9B-Artemis-Q3_K_L.gguf |
4.451 GB |
iq4_xs |
Kev-9B-Artemis-IQ4_XS.gguf |
4.874 GB |
GB is download size, not runtime memory. Quant labels are size classes for these mixed files; the model card lists tensor types.
For code, send model, state and typed questions to /v1/systemone. Keep questions about one input in the same request; splitting them can change the probabilities.
The package sets num_ctx 16384 and num_batch 4096, the card’s llama-server settings (-c 16384 -ub 4096 -b 4096). The batch size moves the probabilities slightly, so keep it when you compare with the card. Inputs longer than 4,096 tokens are accepted.
The selection panels helped choose the files and do not establish performance on unseen inputs. Same-answer rates measure agreement with the original, including its mistakes. Public files can perform better; see the full comparisons on the card. Measurements used llama-server, not Ollama, and Ollama memory use was not measured.
Full measurements and test conditions.
Apache-2.0 (licence). See the Hugging Face repository for LICENSE and NOTICE.
These files keep improving.