60 Downloads Updated 1 week ago
ollama run ActBro/minicpm5-2b-jev
Updated 1 week ago
1 week ago
ff39205e861b · 5.0GB
MiniCPM5-2B-Jev is an open-source, calibrated System 1 Decision Model built on OpenBMB’s MiniCPM5-2B.
It is specifically trained for fast, structured decision-making tasks such as support ticket triage, content moderation, policy enforcement, and agent decision routing.
ollama pull actbro/minicpm5-2b-jev
ollama run actbro/minicpm5-2b-jev "Context: Customer upgraded from Basic to Enterprise and needs SSO SAML configuration.
Question: Which support queue should handle this ticket?
Options:
(A) Billing & Invoices
(B) Enterprise Onboarding (SSO, SAML, dedicated cluster)
(C) General Technical Support
Answer: ("
decision-v7 benchmark, outperforming proprietary TypeSafe Hosted Jev (84.50%) and Together AI’s Tev1 4B (73.3%).import requests
prompt = """Context:
Customer message: "I noticed my card was charged twice on October 1st for the same subscription ($19.99 each). Please refund the extra charge."
Question: Which support intent best matches this request?
Options:
(A) Duplicate charge / refund request
(B) Cancellation request
(C) Account login issue
(D) General inquiry
Answer: ("""
response = requests.post(
"http://localhost:11434/api/generate",
json={
"model": "actbro/minicpm5-2b-jev",
"prompt": prompt,
"stream": False,
"options": {
"temperature": 0.1,
"stop": ["\n", ")"]
}
}
)
decision = response.json()["response"].strip()
print("Selected Option: (", decision, ")", sep="")
curl http://localhost:11434/api/generate -d '{
"model": "actbro/minicpm5-2b-jev",
"prompt": "Context:\nRefund policy: Customers are eligible for a full refund within 30 days of purchase.\nCase: Purchase date Jan 10, refund requested Jan 24.\n\nQuestion: Is this purchase eligible for a refund?\nOptions:\n(A) Yes\n(B) No\nAnswer: (",
"stream": false,
"options": {
"temperature": 0.1,
"stop": ["\n", ")"]
}
}'
/v1/systemone Production ServingNote on Ollama’s
/v1/systemoneendpoint:
Ollama 0.35 introduced an experimental/v1/systemoneendpoint with an internal allowlist currently restricted to specific built-in models.
If you need:
1. Full TypeSafe Jev API compliance (/v1/systemone with state and multi-question questions dictionary),
2. Single-pass non-autoregressive speed with shared-prefix KV caching,
3. Exact calibrated probability distributions and prior debiasing via head.pt,
Please use the native production FastAPI server provided in our official GitHub repository:
# Clone the repository
git clone https://github.com/yuting-ai/minicpm5-2b-jev
cd minicpm5-2b-jev
# Install dependencies and start server
pip install -r requirements.txt
python serve.py --port 8000
Once running, it natively serves the standard TypeSafe Jev API at http://localhost:8000/v1/systemone with complete calibration.