43 3 hours ago

Text-only decision-model Kev-27B GGUF files. Default: iq4_xs. TurinTech models, built with Artemis.

ollama run turintech/kev-27b-artemis

Models

View all →

Readme

Kev-27B Artemis

Text-only GGUF files of Kev-27B, a typed decision model. It returns probabilities for allowed answers through /v1/systemone; plain chat is not supported.

TurinTech models, built with Artemis

Ollama

echo "My Stripe integration keeps failing. Please help ASAP." | ollama run turintech/kev-27b-artemis:iq4_xs --ask "Does this message express urgency?"

latest selects iq4_xs. The explicit tags below use the same model bytes as the corresponding Hugging Face files. Existing size tags remain available.

Tag Hugging Face file Size
iq4_xs (default) Kev-27B-Artemis-IQ4_XS.gguf 13.908 GB
q3_k_m Kev-27B-Artemis-Q3_K_M.gguf 12.314 GB
q4_k_s Kev-27B-Artemis-Q4_K_S.gguf 14.564 GB

GB is download size, not runtime memory. Quant labels are size classes for these mixed files; the model card lists tensor types.

For code, send model, state and typed questions to /v1/systemone. Keep questions about one input in the same request; splitting them can change the probabilities.

The package sets num_ctx 16384 and num_batch 4096, the card’s llama-server settings (-c 16384 -ub 4096 -b 4096). The batch size moves the probabilities slightly, so keep it when you compare with the card. Inputs longer than 4,096 tokens are accepted.

Measurements and limitations

The selection panels helped choose the files and do not establish performance on unseen inputs. Same-answer rates measure agreement with the original, including its mistakes. Public files can perform better; see the full comparisons on the card. Measurements used llama-server, not Ollama, and Ollama memory use was not measured.

Full measurements and test conditions.

Licence

Apache-2.0 (licence). See the Hugging Face repository for LICENSE and NOTICE.

These files keep improving.