MiniCPM5-2B — Ollama Model (2.5B, 131K context)

Model: oamazonasgabriel/minicpm-2b:q4_k_m · oamazonasgabriel/minicpm-2b:bf16 · oamazonasgabriel/minicpm-2b:mlx

DESCRIPTION

A lightweight Ollama build of MiniCPM5-2B, the 2B-class open-source SOTA model from OpenBMB — a dense 2.5B-parameter causal LM built for on-device, local deployment, and resource-constrained scenarios. Reaches 2B-class open-source SOTA across coding, math reasoning, long-context understanding, tool use, and agentic tasks.

The ideal agentic/tool-calling companion for: RTX 5060 Ti 16GB + RTX 4060 Ti 8GB (dual) · RTX 4090 · any NVIDIA setup with 8 GB+ VRAM · Apple Silicon (via MLX)

Key Features

• Dense 2.5B architecture: standard LlamaForCausalLM — no custom kernels, runs anywhere llama.cpp runs
• 131K native context: full 131,072-token window configured by default
• Reasoning / thinking mode: emits thinking blocks before the final response (returned by Ollama as message.thinking)
• Tool calling: trained XML format (<function name="..."><param name="...">...</param></function>); tool schemas are injected via the chat template — for full agentic tool loops today, use llama.cpp --jinja or SGLang (--tool-call-parser minicpm5) until Ollama ships a native minicpm5 parser
• Fast generation: ~2.5B params — runs comfortably on a single 8 GB card
• Multilingual: English, Chinese, Spanish, French, German, Japanese, and more
• Apache 2.0 license: free for commercial and personal use

Architecture

REQUIREMENTS

Platform support: - NVIDIA GPU (dual): 16 GB + 8 GB (RTX 5060 Ti + RTX 4060 Ti) — verified - NVIDIA GPU (single): 8 GB+ VRAM for Q4_K_M, 16 GB+ for BF16 - Apple Silicon: :mlx tag (1.4 GB, 4-bit MLX) — native Metal performance - AMD GPU: ROCm-compatible (not verified for this build)

QUICK START

1. Install Ollama

# Linux
curl -fsSL https://ollama.com/install.sh | sh

# macOS / Windows
# Download from https://ollama.com/download

2. Pull & Run

# Pull the 4-bit model (fast, 1.6 GB)
ollama pull oamazonasgabriel/minicpm-2b:q4_k_m

# Run interactively
ollama run oamazonasgabriel/minicpm-2b:q4_k_m

# Single prompt
ollama run oamazonasgabriel/minicpm-2b:q4_k_m \
  "Write a Python function to fetch and parse a JSON API"

USAGE

CLI

# Interactive chat
ollama run oamazonasgabriel/minicpm-2b:q4_k_m

# Full precision (5.0 GB)
ollama run oamazonasgabriel/minicpm-2b:bf16

# With a system prompt
ollama run oamazonasgabriel/minicpm-2b:q4_k_m \
  --system "You are a rigorous code reviewer"

REST API

# Chat completion (thinking + answer)
curl -s http://127.0.0.1:11434/api/chat \
  -d '{
    "model": "oamazonasgabriel/minicpm-2b:q4_k_m",
    "messages": [{"role": "user", "content": "What is 17 * 23?"}],
    "stream": false
  }'
# Reasoning arrives in "message.thinking", the answer in "message.content"

# OpenAI-compatible endpoint (for agent harnesses)
curl -s http://127.0.0.1:11434/v1/chat/completions \
  -d '{
    "model": "oamazonasgabriel/minicpm-2b:q4_k_m",
    "messages": [{"role": "user", "content": "Hello!"}],
    "stream": false
  }'

Python (ollama library)

pip install ollama

import ollama

response = ollama.chat(
    model='oamazonasgabriel/minicpm-2b:q4_k_m',
    messages=[{'role': 'user', 'content': 'Debug this SQL query'}],
)
print(response.message.content)

JavaScript (ollama.js)

npm install ollama

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'oamazonasgabriel/minicpm-2b:q4_k_m',
  messages: [{ role: 'user', content: 'Hello!' }],
})
console.log(response.message.content)

SAMPLING PARAMETERS

These are baked into the model via its Modelfile:

💡 min_p note: llama.cpp’s default min_p=0.05 can cause repetitive output on this model — set min_p=0.0 (OpenBMB recommendation). If you still see repetition, add repetition_penalty=1.05.

MEMORY & PERFORMANCE

VRAM Budget (Q4_K_M, 131K context)

Context Window Scaling

The dense 2.5B model has a tiny footprint — the full 131K context fits on a single 8 GB card.

MONITORING

# Check model is GPU-resident
ollama ps

# Real-time GPU usage (NVIDIA)
watch -n 1 nvidia-smi

# Ollama server logs (Linux)
journalctl -u ollama -n 50 --no-pager

TROUBLESHOOTING

Opencode / nolock Integration

Add to ~/.config/opencode/opencode.jsonc (or the project’s .opencode/opencode.jsonc):

"oamazonasgabriel/minicpm-2b:q4_k_m": {
  "name": "MiniCPM5 2B (Q4_K_M)",
  "tools": true
}

Use as agent:

"model": "ollama/oamazonasgabriel/minicpm-2b:q4_k_m"

Tool calling is verified working through ollama’s OpenAI-compatible endpoint — MiniCPM5-2B emits tool_calls natively, so OpenCode/nolock/Cline parse them directly.

ALTERNATIVE MODELS

# Full precision (5.0 GB, best quality)
ollama pull oamazonasgabriel/minicpm-2b:bf16

# Official higher-quality quants from OpenBMB
ollama pull hf.co/openbmb/MiniCPM5-2B-GGUF:Q8_0    # 2.7 GB

# Apple Silicon (MLX 4-bit, 1.4 GB)
ollama pull oamazonasgabriel/minicpm-2b:mlx

CREDITS

LINKS