34 yesterday

ollama run orcarouter/Ripple-65B-abliterated:mix-4bit

Details

yesterday

cbf80da7b51f · 32GB

ricursive
·
64.8B
·
BF16
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

Readme

OrcaRouter Ripple-65B-abliterated Abliterated (refusal-removed) Ripple-65B Preview for Ollama — dense reasoning for agentic coding · up to 1M context

Apache-2.0 · 5 tags · 20–130 GB · Mix-2.5bit to Mix-8bit · BF16 · one GPU

Website · Model Catalog · Hugging Face · GitHub · Discord · X


🛡️ New from Orca — OrcaCyber Zero 1.5

Post-trained for cybersecurity: vulnerability analysis, vulnerability reproduction, red teaming & offensive-security research. 98.01% pass@1 on CyberGym Level 1 · 1M context · function calling · OpenAI-compatible API.

Try it on OrcaRouter →

🔓 All hosted cyber and abliterated models as API

Skip the download: OrcaRouter serves its cybersecurity and abliterated models behind one OpenAI-compatible API key.

Browse cyber and abliterated models →

🔌 New from Orca — Orca Connect

Running this in Ollama on your own machine? Orca Connect puts the rig under your desk behind your usual OrcaRouter API key, next to 200+ hosted models, reachable from a laptop, a phone or a cloud agent. Outbound only: no port forwarding, no tunnel, no firewall rule. Requests your own hardware serves cost $0, and orca-connect claude points Claude Code at your rig for one session.

Connect your rig → · ▶ Watch the demo


Abliterated Ripple-65B Preview, run locally.

These are Ollama builds of the abliterated (refusal-removed) ricursiveAI/Ripple-65B-Preview, a 65B dense reasoning model for agentic coding, with up to 1M context.

Harmful-prompt refusal drops from 95.5% to 11.8%, and capability is unchanged within run-to-run noise.

The four quantized builds are mixed precision at a fixed file size, in stock llama.cpp types, so no custom kernels are needed.

Stock llama.cpp quants of this model degrade fast below 5 bits; these hold up. On held-out text, the 24 GB build has 22× less KLD than the stock IQ3_XXS, and the 32 GB build is closer to the BF16 than the 46 GB Q5_K_M.


⚠️ Disclaimer — read before use

This model is abliterated: its safety alignment has been substantially reduced. It will comply with many harmful, unethical, offensive, or illegal requests that the original Ripple-65B-Preview would refuse.

  • It is released strictly for legitimate research: interpretability, AI safety and refusal-mechanism study, red teaming, and robustness evaluation.
  • You assume full responsibility for how you use it and for everything it generates. Add your own safety, moderation and abuse-prevention layers before any deployment.
  • Use must comply with the Apache License 2.0 inherited from the base model, and with all applicable law.
  • The authors accept no liability for misuse. Its outputs do not reflect the views of the uploaders or of Ricursive Intelligence.

Pick a tag

Tag Size bpw KLD ↓ Top-1 ↑ PPL vs. BF16
bf16 129.6 GB 16.00 (reference) (reference) (reference)
mix-8bit 63.9 GB 7.89 0.00059 99.3% +0.1%
mix-4bit · latest 32.0 GB 3.95 0.0059 97.6% +0.5%
mix-3bit 24.0 GB 2.96 0.024 95.2% +2.3%
mix-2.5bit 20.0 GB 2.47 0.050 93.1% +5.4%
  • Mix-4bit is the one to use if 32 GB fits, for example on a 48 GB card or two 24 GB cards. 97.6% of next tokens match the BF16.
  • Mix-3bit is for a 32 GB card, and still closer to the BF16 than any stock quant up to 39 GB.
  • Mix-2.5bit is for a 24 GB card at short context. 93% of next tokens match.
  • Mix-8bit is near-lossless, for an 80 GB card.
  • BF16 is the unquantized model, and the reference every KLD here is measured against.

The KV cache is small for a 65B model: about 2.4 GB for 32K tokens of context and 8.9 GB for 128K in F16, on top of the file. The fits above are estimates; all measurements were made on H200s.


Usage (Ollama)

Requires Ollama v0.40.16 or later.

ollama run orcarouter/Ripple-65B-abliterated              # Mix-4bit
ollama run orcarouter/Ripple-65B-abliterated:mix-3bit     # 32 GB card

cURL

curl http://localhost:11434/api/chat -d '{
  "model": "orcarouter/Ripple-65B-abliterated",
  "messages": [{"role": "user", "content": "Hello!"}]
}'

Python

from ollama import chat
resp = chat(
    model="orcarouter/Ripple-65B-abliterated",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(resp["message"]["content"])
  • Thinking. Ollama’s built-in Ripple renderer builds the same prompt as the chat template in the GGUF, so "think" and --think change nothing. Ripple decides for itself when to reason.
  • Context. Set num_ctx for long prompts, for example 32768.

Evaluation

Fidelity to the BF16

Every build is scored against the abliterated BF16 GGUF with llama.cpp’s full-vocabulary KLD (llama-perplexity --kl-divergence), on 128 windows of 2048 tokens of held-out chat, code, reasoning and multilingual text that was not used to make the builds. The stock files were quantized from the same BF16 with the same llama.cpp build.

Each stock type is shown at the best of three: no importance matrix, an importance matrix from our calibration text, and one from wikitext-2 train. On Ripple an importance matrix makes the Q3_K and Q4_K types worse, so those are shown without one.

File bpw KLD ↓ KLD p99 ↓ Top-1 ↑ PPL vs. BF16
Q8_0 68.84 GB 8.50 0.00034 0.0037 99.39% +0.03%
Mix-8bit (ours) 63.86 GB 7.89 0.00059 0.0055 99.31% +0.09%
Q6_K 53.15 GB 6.56 0.00187 0.0211 98.64% −0.07%
Q5_K_M 45.76 GB 5.65 0.0161 0.193 96.14% +2.5%
Q4_K_M 38.80 GB 4.79 0.0537 0.663 92.75% +5.6%
Q4_K_S 36.85 GB 4.55 0.0573 0.690 92.54% +6.2%
IQ4_XS 34.64 GB 4.28 0.0374 0.462 94.10% +3.7%
Mix-4bit (ours) 32.00 GB 3.95 0.0059 0.078 97.65% +0.5%
Q3_K_M 31.02 GB 3.83 0.173 1.93 86.55% +20%
IQ3_S 28.10 GB 3.47 0.500 4.74 77.14% +63%
IQ3_XXS 24.97 GB 3.08 0.529 5.15 76.72% +68%
Mix-3bit (ours) 23.97 GB 2.96 0.0238 0.307 95.23% +2.3%
Q2_K 23.75 GB 2.93 2.39 10.4 46.81% ×11
IQ2_M 21.86 GB 2.70 0.466 4.57 78.25% +60%
IQ2_S 20.08 GB 2.48 0.540 5.07 76.42% +73%
Mix-2.5bit (ours) 19.99 GB 2.47 0.0501 0.633 93.11% +5.4%
  • Mix-2.5bit is the size of IQ2_S, with 11× less KLD, and 9× less than the larger IQ2_M.
  • Mix-3bit is 1 GB smaller than IQ3_XXS, with 22× less KLD. It is closer to the BF16 than any stock quant up to Q4_K_M, 15 GB larger.
  • Mix-4bit is 2.6 GB smaller than IQ4_XS, with 6× less KLD, and is closer to the BF16 than the 46 GB Q5_K_M.
  • Mix-8bit sits between Q6_K and Q8_0 in both size and KLD.

Method note. These are full-vocabulary KLD and next-token agreement at 2K context, not a downstream benchmark.

Abliteration

These numbers were measured on the abliterated BF16 in SGLang 0.5.19 against the original Ripple-65B-Preview, with identical prompts, splits and seed, greedy decoding and thinking on. Refusal is judged on the final answer by a rule-based classifier, not an LLM judge, so treat the numbers as indicative.

Harmful-prompt refusal (lower = more uncensored). Average 11.8%, against 95.5% for the original.

Benchmark n Original Abliterated Caveat (original → abliterated)
AdvBench 100 99.0% 14.0% 100.0% → 60.0%
JailbreakBench (harmful) 100 97.0% 13.0% 98.0% → 51.0%
StrongREJECT 150 100.0% 10.7% 100.0% → 44.0%
HarmBench (standard) 150 99.3% 18.7% 99.3% → 33.3%
MaliciousInstruct 100 99.0% 1.0% 100.0% → 41.0%
SimpleSafetyTests 50 100.0% 14.0% 100.0% → 36.0%
ForbiddenQuestions 150 74.0% 11.3% 87.3% → 40.0%

The model now answers, but often still opens with a safety disclaimer.

Over-refusal on benign prompts (lower = better).

Benchmark n Original Abliterated
XSTest-safe 250 7.6% 4.4%
JailbreakBench (benign) 100 19.0% 5.0%

Capability. Unchanged within run-to-run noise.

Benchmark n Original Abliterated Acc. on finished items Unfinished
MMLU (letter) 300 87.0% 85.7% 93.5% → 92.1% 7.0% → 7.0%
MMLU-Pro (CoT) ⚠ 250 78.8% 78.4% 89.5% → 89.1% 12.0% → 12.0%
GSM8K (CoT) 150 94.0% 94.0% 95.3% → 95.9% 1.3% → 2.0%
CMMLU (letter) ⚠ 500 68.0% 66.6% 83.5% → 83.7% 18.6% → 20.4%

⚠ Unfinished items cap the headline accuracy, on both checkpoints. Under greedy decoding Ripple keeps deliberating on some multiple-choice items until the budget runs out; those count as wrong. Accuracy on finished items is flat.


Model details

Base model ricursiveAI/Ripple-65B-Preview, abliterated
Architecture ricursive in llama.cpp. 80 layers: 64 sliding-window (1024) + 16 global attention layers; gated attention; value residuals; hidden 5120, SwiGLU MLP (intermediate 40960); GQA 80 query / 8 KV heads × 128
Weights 64.8B, dense
Quantization Per-group mixed precision at a fixed file size, from the abliterated BF16, in stock llama.cpp types
Context up to 1M tokens (inherited; evaluated at 2K) · Vocabulary 100,352
Runtime llama.cpp master (PR #31692 or later) or Ollama v0.40.16+; text in, text out

Bias, risks, and limitations

  • Safety guardrails are substantially reduced. See the disclaimer. The model still often prefaces compliant answers with a disclaimer.
  • Mix-2.5bit is noticeably degraded. 93% next-token agreement is a real cut. It is the best we found at 20 GB, not a match for the BF16.
  • The benchmark suite was run on the BF16 in SGLang, not on these files. The quantized builds were checked for fidelity (KLD) only.
  • Not measured: downstream accuracy of the quantized builds, long context, agentic coding and tool use, and sampled decoding.
  • Tested on CUDA only. CPU and Apple Metal have not been run with these files.
  • Inherits the biases and limitations of Ripple-65B-Preview.
  • Requires llama.cpp with PR #31692 (merged 2026-11-05), or Ollama v0.40.16 or later. Tools built on older llama.cpp, such as LM Studio, will not load these files until they pick up that change.

License

The Apache License 2.0, inherited from the base model ricursiveAI/Ripple-65B-Preview.

Elsewhere


One Gateway. Every Model.

Route Smarter · Ship Safer · Spend Less

Website · Models · GitHub · Discord · X