43 Downloads Updated 18 hours ago
ollama run aminroudaki/decisio-gemma-tuned
decisio-gemma-tuned answers closed questions about any text or image with a tuned Gemma 4 12B, with a calibrated probability for every option.
Give it a piece of text, optionally images, and one or more questions (yes/no, a choice among up to 255 options, or a score on a scale you define); it returns, for each question, the chosen answer and how likely each option is, from one forward pass per question.
It is Decisio-12b-tuned-calibrated with the decisio server’s prompt and fitted temperatures, and on the questions measured its q8_0 tag chooses the same answer as decisio’s own server for 99% of them.
Requires Ollama 0.40.4 or later (checked on 0.40.4, 0.40.9 and 0.40.16).
ollama pull aminroudaki/decisio-gemma-tuned
curl http://localhost:11434/v1/systemone -d '{
"model": "aminroudaki/decisio-gemma-tuned",
"state": "Order 4471 shipped on Monday. The customer writes: My parcel arrived with the box crushed and the lamp inside broken.",
"questions": {
"intent": {"type": "choice", "instructions": "What does the customer want?",
"criteria": {"track_order": null, "report_damage": null, "cancel_order": null, "change_address": null}},
"refund": {"type": "noul", "instructions": "Is the customer likely to ask for a refund or replacement?"}
}
}'
Images go in the request’s images field, base64-encoded.
| Tag | Download | Memory while answering (8,192-token context) |
|---|---|---|
q4_k_m (also latest) |
7.5 GB | 10.8 GB |
q8_0 |
12.8 GB | 15.9 GB |
Memory was measured on a Mac as the resident set of Ollama’s runner: the weights, mapped from the file, and about 3.5 GB of buffers.
systemone chat template. For a request of one question with at most 68 options it is the decisio server’s prompt byte for byte.On 300 questions from decisio’s test suite, the q8_0 tag chose the same answer as decisio’s own server for 99.0% of them and the q4_k_m tag for 94.7%; on 257 image questions both chose decisio’s answer for 97%.
No accuracy difference was outside its 95% interval.
Where it differs from the decisio server: - in a request of several questions, each question’s prompt lists only its own question; - images go before the text, apply to the whole request, and are read near their own resolution; there is no Box question; - the commit flavor (Decisio-12b-tuned-commit), tasks, abstention and the fast table are not available here.
For those, run decisio itself with --base tachara-ai/Decisio-12b-tuned-calibrated: github.com/aminry/decisio.
The Gemma 4 12B base is aminroudaki/decisio-gemma.