243 Downloads Updated 1 month ago
curl http://localhost:11434/v1/systemone \
-H "Content-Type: application/json" \
-d '{
"model": "ActBro/minicpm5-2b-jev",
"state": "Hello World",
"questions": {
"says_hello": {
"type": "noul",
"instructions": "Does the state text contain a greeting?",
"criteria": {
"true": "The state text contains a greeting.",
"false": "The state text does not contain a greeting."
}
}
}
}'
Updated 1 month ago
1 month ago
e0ad422fd709 · 5.0GB
MiniCPM5-2B-Jev is an open-source, calibrated System 1 Decision Model built on OpenBMB’s MiniCPM5-2B.
It is specifically trained for single-pass, structured decision-making tasks such as support ticket triage, content moderation, policy enforcement, and agent decision routing. It natively supports Ollama 0.35+’s structured /v1/systemone decision protocol without autoregressive text generation.
ollama pull actbro/minicpm5-2b-jev:2b
ollama run actbro/minicpm5-2b-jev:2b "Context: Customer upgraded from Basic to Enterprise and needs SSO SAML configuration.
Question: Which support queue should handle this ticket?
Options:
(A) Billing & Invoices
(B) Enterprise Onboarding (SSO, SAML, dedicated cluster)
(C) General Technical Support
Answer: ("
decision-v7 benchmark, outperforming proprietary TypeSafe Hosted Jev (84.50%) and Together AI’s Tev1 4B (73.3%).output_tokens: 1), achieving sub-100ms response times./v1/systemone Decision API (Recommended)Ollama 0.35+ natively supports the System One decision endpoint (/v1/systemone). You can send structured states and questions directly to Ollama.
curl http://localhost:11434/v1/systemone \
-H "Content-Type: application/json" \
-d '{
"model": "actbro/minicpm5-2b-jev:2b",
"state": "Ticket #402: Customer wants to cancel subscription and request a full refund.",
"questions": {
"intent": {
"type": "choice",
"instructions": "Select the customer intent.",
"criteria": {
"refund": "Billing and refund requests",
"tech_support": "Technical bug reports"
}
},
"is_urgent": {
"type": "noul",
"instructions": "Does this request indicate an urgent service outage?"
}
}
}'
Response Format:
{
"model": "actbro/minicpm5-2b-jev:2b",
"answers": {
"intent": {
"type": "choice",
"choice": "refund",
"probabilities": {
"refund": 0.99999,
"tech_support": 0.00001
},
"confidence": 0.9998
},
"is_urgent": {
"type": "noul",
"noul": false,
"probabilities": {
"true": 0.00002,
"false": 0.99998
},
"confidence": 0.9999
}
},
"usage": {
"input_tokens": 146,
"output_tokens": 1
}
}
import ollama
client = ollama.Client()
response = client.systemone(
model="actbro/minicpm5-2b-jev:2b",
state="Customer message: 'I noticed my card was charged twice on October 1st ($19.99 each). Please refund the extra charge.'",
questions={
"intent": {
"type": "choice",
"instructions": "Route this ticket to the appropriate queue.",
"criteria": {
"billing_refund": "Duplicate charges, invoices, refunds",
"cancellation": "Account or subscription cancellation",
"tech_support": "Login errors or general technical bugs",
},
},
"is_refund": {
"type": "noul",
"instructions": "Is the customer requesting a money refund?",
},
},
)
print("Selected Queue:", response.answers["intent"].choice)
print("Queue Probabilities:", response.answers["intent"].probabilities)
print("Is Refund (Yes/No):", response.answers["is_refund"].noul)
requests HTTP)import requests
payload = {
"model": "actbro/minicpm5-2b-jev:2b",
"state": "Customer message: 'I noticed my card was charged twice ($19.99 each). Please refund the extra charge.'",
"questions": {
"intent": {
"type": "choice",
"instructions": "Route this ticket to the appropriate queue.",
"criteria": {
"billing_refund": "Duplicate charges, invoices, refunds",
"tech_support": "Login errors or technical bugs",
},
}
},
}
resp = requests.post("http://localhost:11434/v1/systemone", json=payload)
data = resp.json()
print("Selected Intent:", data["answers"]["intent"]["choice"])
print("Probabilities:", data["answers"]["intent"]["probabilities"])
/api/generate API (Compatibility Mode)For legacy pipelines or environments where /v1/systemone is not yet adopted:
import requests
prompt = """Context:
Customer message: "I noticed my card was charged twice on October 1st for the same subscription ($19.99 each). Please refund the extra charge."
Question: Which support intent best matches this request?
Options:
(A) Duplicate charge / refund request
(B) Cancellation request
(C) Account login issue
(D) General inquiry
Answer: ("""
response = requests.post(
"http://localhost:11434/api/generate",
json={
"model": "actbro/minicpm5-2b-jev:2b",
"prompt": prompt,
"stream": False,
"options": {
"temperature": 0.1,
"stop": ["\n", ")"]
}
}
)
decision = response.json()["response"].strip()
print("Selected Option: (", decision, ")", sep="")
serve.py)If you require running outside of Ollama (e.g. distributed PyTorch clusters, raw CUDA/MPS, or using our post-hoc calibration layer head.pt with class-balanced marginal prior debiasing):
# Clone the official repository
git clone https://github.com/yuting-ai/minicpm5-2b-jev
cd minicpm5-2b-jev
# Install dependencies and start server
pip install -r requirements.txt
python serve.py --port 8000