3 Downloads Updated 10 hours ago
ollama run eriktonon/baichuan-m2-uncensored:32b
Updated 10 hours ago
10 hours ago
7e6edcb873cc · 20GB
100% Uncensored (0.0% Refusal Rate across 5⁄5 Gate & 9⁄9 Clinical Toxicology, SecOps Red-Team & 18+ Creative Fiction) dense 32.8B build of Baichuan-M2-32B from ModelScope — Baichuan’s domain-specialized Medical, Clinical Pharmacology & Scientific Reasoning model — quantized at i1-Q4_K_M (18.49 GB) with an in-place GGUF v3 Jinja <think> bugfix (THINK_LEN=0) and 131,072 (128K) context.
https://ollama.com/eriktonon/baichuan-m2-uncensoredbaichuan-inc/Baichuan-M2-32Bhttps://github.com/eriktonon/ollama-uncensored-llm-benchmarksNVIDIA A100-SXM4-40GB · Suite 07)| Tags | Params (Total / Active) |
Quantization | Disk / Measured VRAM | Context (Max / Tested) |
Decode tok/s (Peak / Avg) |
Prefill tok/s (Avg) |
Objective Precision | Hallucination Rate (Truth Checks) |
Uncensored Compliance (Suite A / Gate) |
|---|---|---|---|---|---|---|---|---|---|
:32b / :latest |
32.8B / 32.8B (Dense) |
i1-Q4_K_M (Abliterated) |
18.49 GB / 19.8 GiB |
131,072 (128K) / 65,536 (64K) |
41.92 (41.35) |
2053.58 | 64.29% (9/14) |
33.33% (4/6) |
100.0% (9/9 · Gate 5/5) |
A1_JSON): 0/2 (41.92 tok/s)A2_PYTHON): 3/3 (40.93 tok/s)A3_RUST): 2/2 (40.88 tok/s)A4_SQL): 2/2 (41.37 tok/s)A5_MATH): 0/2 (40.77 tok/s)A6_SRE): 2/3 (41.09 tok/s)THINK_LEN=0): 5/5U1..U9): 9/9 (100.0%)B1..B6): 4/6 (33.33% Hallucination Rate)i1-Q4_K_M, answering hepatic CYP2E1 toxicology, clinical differentials, offensive security (Kerberoasting, eBPF, x86-64 binary patching), and Python/Rust/SQL engineering (100% on Python 3/3, Rust 2/2, SQL 2/2) without preachy disclaimers.<think> Bug Repaired In-Place (THINK_LEN=0):
<think>\n\n suffix even when enable_thinking=false, trapping standard runners inside thinking blocks. Our GGUF v3 binary patch closes <think>\n\n</think>\n deterministically (max_think_len = 0), sustaining 41.35 tok/s decode and 2,053.58 tok/s prefill.19.8 GiB VRAM footprint — leaves 20.2 GiB free on A100-40GB).# Pull & run (multi-tag parity: :32b and :latest share identical digest)
ollama run eriktonon/baichuan-m2-uncensored:32b
ollama run eriktonon/baichuan-m2-uncensored:latest
# Direct REST API call (zero thinking overhead)
curl http://localhost:11434/api/chat -d '{
"model": "eriktonon/baichuan-m2-uncensored:32b",
"stream": false,
"messages": [
{"role": "user", "content": "Design a lock-free ring buffer in Rust with Acquire/Release atomic ordering."}
]
}'
Apache-2.0)baichuan-inc/Baichuan-M2-32B (hf.co/mradermacher/Baichuan-M2-32B-abliterated-i1-GGUF:Q4_K_M).