Laya requires Ollama 0.40.0 or later.

Laya is a 421M decision model from Convai Innovations, fine-tuned from ModernBERT-large.

It scores every option of every question in a single forward pass and returns typed answers with calibrated probabilities. There is no language-model decoder and no text generation — nothing to parse, nothing to hallucinate.

The shipped checkpoint is fine-tuned on real, human-annotated workflows: email triage (spam, phishing, and department routing), content safety, intent routing, and fact verification.

ollama pull laya

Highlights

• Small and fast: 421M parameters. Can answer one question in under 10 ms on M5 Max.
• Calibrated probabilities: trained with RLCD against strictly proper scoring rules, so the only way to maximize reward is to report honest probabilities. In-task calibration error (ECE) is 0.060.
• Three question types: Pick from a list, answer true or false, or place something on a rubric.
• Many questions per request: Ask up to 64 questions about the same text in one call. They share a single forward pass.
• Apache 2.0 license

What you can build

API

Decision models use Ollama’s /v1/systemone endpoint, which follows TypeSafe’s Jev API. Put the text you want judged in state and your questions in questions. Ollama builds Laya’s prompt for you.

Every question has a type, instructions, and usually criteria:

Choice and score questions take 2 to 26 options. Every option shares a fixed token budget inside Laya’s decision head, so large label sets narrow what each option looks like to the model; keep a single choice question to roughly 20 options. confidence runs from 0 to 1 and shows how concentrated the probabilities are. It isn’t the chance that the answer is right.

cURL

curl http://localhost:11434/v1/systemone -d '{
  "model": "laya",
  "state": {
    "from": "customer@acme.com",
    "subject": "Duplicate billing on March invoice #4411",
    "body": "Hi team, we were billed twice for March. Please refund the duplicate before Friday or we will cancel our plan."
  },
  "questions": {
    "department": {
      "type": "choice",
      "instructions": "Which department should handle this email?",
      "criteria": {
        "billing": "Invoices, payments, refunds",
        "technical": "Bugs, outages, integrations",
        "sales": "Pricing, contracts, demos",
        "other": "Everything else"
      }
    },
    "urgency": {
      "type": "score",
      "instructions": "How urgent is this request?",
      "criteria": ["Not urgent", "Soon", "Critical deadline or blocking issue"]
    },
    "churn_risk": {
      "type": "noul",
      "instructions": "Does the user threaten to cancel or switch to a competitor?"
    },
    "is_phishing": {
      "type": "noul",
      "instructions": "Is this email a phishing or scam attempt?"
    }
  }
}'

The response has an entry under answers for each question, with its probabilities and confidence:

{
  "model": "laya",
  "answers": {
    "department": {
      "type": "choice",
      "choice": "billing",
      "probabilities": {"billing": 0.94, "technical": 0.03, "sales": 0.02, "other": 0.01},
      "confidence": 0.87
    },
    "urgency": {
      "type": "score",
      "score": 1.84,
      "legend": {"0": "Not urgent", "1": "Soon", "2": "Critical deadline or blocking issue"},
      "probabilities": {"0": 0.01, "1": 0.16, "2": 0.83},
      "confidence": 0.66
    },
    "churn_risk": {"type": "noul", "noul": 0.89},
    "is_phishing": {"type": "noul", "noul": 0.02}
  },
  "usage": {"input_tokens": 412, "output_tokens": 4}
}

Python

Use TypeSafe’s official Python SDK and point it at Ollama. The SDK requires an API key, but Ollama ignores it, so any value works.

pip install typesafe-sdk
export TYPESAFE_BASE_URL=http://localhost:11434
export TYPESAFE_API_KEY=ollama
export TYPESAFE_DEFAULT_MODEL=laya

from typesafe_sdk import Choice, Noul, Score, TypeSafeClient

questions = {
    "department": Choice(
        instructions="Which department should handle this email?",
        criteria={
            "billing": "Invoices, payments, refunds",
            "technical": "Bugs, outages, integrations",
            "sales": "Pricing, contracts, demos",
            "other": "Everything else",
        },
    ),
    "urgency": Score(
        instructions="How urgent is this request?",
        criteria=["Not urgent", "Soon", "Critical deadline or blocking issue"],
    ),
    "churn_risk": Noul(
        instructions="Does the user threaten to cancel or switch to a competitor?",
    ),
}

with TypeSafeClient(timeout=120) as client:
    result = client.system_one(state={"body": "We were billed twice for March."}, questions=questions)

print(result.choices["department"].choice)   # billing
print(result.scores["urgency"].score)        # expected level on the 0-2 rubric
print(result.nouls["churn_risk"].noul)       # probability the customer threatens to leave

Decision models aren’t in the Ollama CLI or the Ollama Python and JavaScript libraries yet. Use the API or the TypeSafe SDK for now.

More examples

Spam and phishing screen. null descriptions let the flag names describe themselves.

curl http://localhost:11434/v1/systemone -d '{
  "model": "laya",
  "state": {"from": "billing@secure-update.example", "subject": "Urgent: verify your account now", "body": "Your account will be suspended today. Click http://secure-update.example to verify."},
  "questions": {
    "spam": {"type": "noul", "instructions": "Is this email spam?"},
    "phishing": {"type": "noul", "instructions": "Is this email a phishing attempt?"},
    "action": {"type": "choice", "instructions": "What should the mail gateway do with this email?", "criteria": {"deliver": null, "quarantine": null, "reject": null}}
  }
}'

Tool call moderation. Check an agent’s tool call before it runs.

curl http://localhost:11434/v1/systemone -d '{
  "model": "laya",
  "state": "send_email(to=\"all-customers\", subject=\"FINAL NOTICE: account will be suspended today\")",
  "questions": {
    "harm": {"type": "noul", "instructions": "Could this tool call cause harm?"}
  }
}'

Benchmarks

The numbers below come from Convai Innovations and were measured on the shipped checkpoint: the accuracy on the checkpoint’s own in-task test sets, and the Jev column on TypeSafe’s published figures for Jev 1.13. Sample sizes and prompts differ between the two vendors; treat the Jev comparison as indicative, not an independent head-to-head.

Accuracy by task family (in-task test sets, measured by Convai Innovations):

Latency, measured by Convai Innovations on a single GPU:

Against Jev’s published numbers, Convai reports about 10x lower single-question latency and 16 points higher accuracy across four production workflows. On Convai’s selective-automation setup, gating on confidence ≥ 0.85 automates half the decisions at 92.2% accuracy.

Training

Convai Innovations trained Laya with RLCD (Reinforcement Learning for Calibrated Decisions). The policy reports a probability distribution, exploration adds zero-mean Gaussian noise to the logits, and the reward is a strictly proper scoring rule (log score plus spherical score, with a ranked probability score for ordinal questions). The maximum expected reward is achieved only when the model outputs true, calibrated probabilities.

• The backbone is ModernBERT-large (395M), fine-tuned end to end, plus a decision head trained from scratch: 2 transformer layers, an option-marker scorer, and an act/escalate head. 421M parameters in all.
• Every option is scored at its own [MASK] marker token, then a softmax is applied over that question’s options. The answer space is defined at request time, so new schemas need no retraining.
• Multi-turn conversations use temporal-difference learning over prefix slices (TD(λ = 1.0)), so credit flows to the earlier turns that led to an outcome without leaking the outcome into the prompt.
• All training data is human-annotated real-world datasets; Convai reports no synthetic training shortcuts.
• The shipped checkpoint is a fine-tune of the base Laya model (7,313 updates, 1 epoch) that adds dedicated email triage and per-cardinality temperature calibration.

The source repo also publishes two sibling checkpoints, laya-multilingual (mmBERT-base, 322M, 100+ languages, 1,024-token window) and laya-typed-decisions (fine-tuned on the typed-decisions benchmark). Neither ships as part of the laya model on Ollama.

Notes

• Text only, and English only. Each question gets a 512-token budget that covers the instructions, the options, and the state together; longer states are truncated.
• Use /v1/systemone. In a regular chat, Laya has no text generation to fall back on.
• Keep inputs short. Every question is scored with the full state and question set in its prompt.
• If none of your options might fit, add a none option.
• Calibration is measured on Convai’s benchmark sets. A confidence of 0.9 doesn’t mean the answer is right 90% of the time on your data — test any threshold on your own distribution before you rely on it, and refit it on held-out data if the probabilities matter downstream.
• Keep arithmetic, counting, date comparisons, and multi-hop lookups in deterministic code. Ask Laya whether the state satisfies a stated condition instead.
• If noul answers look stuck on “no”, ask the same question as a two-option choice with neutral keys and your yes/no wording as the descriptions.
• It can be wrong. Don’t let it be the only check on a high-stakes decision.
• Request bodies can be up to 64 KiB.