326 13 hours ago

A 2B decision model from Strands Agents for fast classification, routing, and scoring.

decision 2b
curl http://localhost:11434/v1/systemone \
  -H "Content-Type: application/json" \
  -d '{
    "model": "strands-decider:2b",
    "state": "Hello World",
    "questions": {
      "says_hello": {
        "type": "noul",
        "instructions": "Does the state text contain a greeting?",
        "criteria": {
          "true": "The state text contains a greeting.",
          "false": "The state text does not contain a greeting."
        }
      }
    }
  }'

Details

13 hours ago

fd88a2b3ab3f · 2.0GB

{ "producer": { "name": "modelopt", "version": "0.47.0.dev75+gfbcdc16c2.d20260818" }, "quantization"
{ "adapter_sha256": "ae1d0cd1ac3edec6df0a519a3ad18f1c382099032d493f8f98c96a80cfebb4c7", "base_model"
{ "base_model": "Qwen/Qwen3.5-2B-Base", "num_slots": 24, "head_hidden": 0, "head_dropout": 0.05, "ma
{ "version": "1.0", "truncation": { "direction": "Right", "max_length": 4096, "strategy": "LongestFi
{ "add_prefix_space": false, "audio_bos_token": "<|audio_start|>", "audio_eos_token": "<|audio_end|>
# License This model is released under the Apache License 2.0, the same license as the strands-decid
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
{ "num_ctx": 4096 }
{ "architectures": [ "StrandsDeciderForDecision" ], "model_type": "qwen3_5", "text_config": { "atten
326 tensors

Readme

Strands Decider

Requires Ollama 0.40.0 or later on an Apple silicon Mac. These models run with MLX.

Strands Decider is a 2B decision model from Strands Agents for classification, routing, and scoring. It uses Qwen3.5-2B-Base with a trained decision head to assign probabilities to the answers you define, without generating a free-form response.

This release uses the publisher’s v1-2610 checkpoint. It is licensed under Apache 2.0.

Highlights

  • Three question types: choose a category, answer a Boolean question, or rate an input against an ordered rubric.
  • Multiple questions per request: assess several aspects of the same text.
  • 4K context: the formatted state and questions must fit within 4,096 tokens.
  • Compact weights: MLX variants range from 1.3 GB to 3.8 GB.

Use it to choose a tool, route a support ticket, apply a written policy, or evaluate an answer against a rubric.

API

Send requests to /v1/systemone. Put the evidence in state and your named questions in questions. The response’s answers object uses the same question names.

Type Criteria Answer
choice Option names mapped to descriptions. Selected choice and each option’s probabilities.
noul Optional descriptions of true and false. noul: the probability that the answer is true.
score An array of level descriptions, in ascending order. Probability-weighted score, with levels numbered from zero.

The default model uses MXFP8:

ollama pull strands-decider
curl --fail-with-body -sS http://localhost:11434/v1/systemone \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "strands-decider",
    "state": "Returns are allowed within 30 days. This item was bought 12 days ago. It arrived undamaged.",
    "questions": {
      "eligible": {
        "type": "noul",
        "instructions": "Is this item within the store return window?",
        "criteria": {}
      },
      "department": {
        "type": "choice",
        "instructions": "Which department handles a return?",
        "criteria": {
          "returns": "Product returns and refunds",
          "technical": "Software installation"
        }
      },
      "damage": {
        "type": "score",
        "instructions": "How damaged was the item?",
        "criteria": ["Undamaged", "Minor damage", "Destroyed"]
      }
    }
  }'

For this example, expect eligibility above 0.5, the returns department, and a damage score below 0.5. Exact probabilities vary by weight format.

MLX variants

Tag Weight format Download size
strands-decider, strands-decider:latest, strands-decider:2b MXFP8 (default) 2.0 GB
strands-decider:2b-mlx-bf16 Unquantized BF16 3.8 GB
strands-decider:2b-mxfp8 MXFP8 2.0 GB
strands-decider:2b-nvfp4 NVFP4, with MXFP8 embeddings 1.3 GB

Sizes are approximate. Runtime memory also includes caches and working buffers. MLX quantization uses NVIDIA Model Optimizer and retains the decision head at its original precision.

Evaluation

The publisher reports 180⁄231 correct on JevBench, measured with its reference implementation at a 4,096-token window.

Our separate Ollama measurements used unmodified JevBench, with all 231 original, easy, and hard cases. All requests completed without API or schema errors.

MLX variant Correct / 231 Median latency p95 latency
BF16 182 33.3 ms 343.5 ms
MXFP8 183 42.5 ms 384.8 ms
NVFP4 182 41.5 ms 372.8 ms

Measured on an Apple M5 Pro with 64 GiB RAM, macOS 27.0, and Ollama 0.40.0. Each variant had a fresh runner, one warmup request, and one serial pass through the corpus, with no competing GPU workload. Prompts ranged from 82 to 3,936 tokens. Latencies are full HTTP request times with the model loaded; fans were automatic. Different requests and hardware will produce different timings.

Limitations

These Ollama packages support text decisions. Use the decision API; chat generation and image input are not supported.

The publisher identifies weaknesses on long, multi-step documents and unfamiliar Boolean or scoring tasks. Changes to question wording may not change the answer as intended. Use clear options and test your actual prompts before relying on a decision threshold. The model’s calibration was fitted on short classification tasks; probabilities are not guarantees of correctness.