FableForge-AI/ shellwhisperer:q6_k

99 1 month ago

Ultra-fast 1.5B shell command assistant. 986MB, 32K context. Predicts shell commands instantly. Perfect for terminal workflows, system admin, DevOps. Runs on ANY device — phones, Pi, old laptops. 20+ tok/s. Apache 2.0. 

ollama run FableForge-AI/shellwhisperer:q6_k

Details

1 month ago

c1c24aa47361 · 1.3GB ·

model
qwen2
·
1.54B
·
Q6_K
system
You are ShellWhisperer, an ultra-fast shell command assistant. Be concise and direct.
params
{ "num_ctx": 32768, "temperature": 0.3 }

Readme

ShellWhisperer — Ultra-Fast Shell Command Assistant

986MB. 20+ tok/s. Runs on anything. The fastest shell AI on Ollama.

Overview

ShellWhisperer is a tiny but powerful 1.5B parameter model fine-tuned specifically for shell command prediction and system administration. Based on Qwen2.5-0.5B, it’s ultra-lightweight and runs on virtually any device.

Quick Start

ollama run FableForge-AI/shellwhisperer

Hardware Requirements

Hardware Can Run? Speed
Any phone (2GB+ RAM) Full ~20 tok/s
Raspberry Pi Zero Full ~15 tok/s
Old laptop Full ~25 tok/s
RTX 3060+ Full GPU ~40 tok/s
M1 Mac Full GPU ~35 tok/s

Size: 986MB · Context: 32K · Base: Qwen2.5-0.5B

Why Use ShellWhisperer?

  • Ultra-fast: 20+ tok/s on CPU — instant shell command suggestions
  • Tiny: Under 1GB — runs on phones, Pi, anything
  • Specialized: Trained specifically on shell commands and sysadmin tasks
  • 32K context: Handles long terminal sessions and complex pipelines

Capabilities

Shell Command Prediction

User: Find all files modified in last 7 days
ShellWhisperer: find / -type f -mtime -7 2>/dev/null | head -20

System Administration

User: Check disk usage of all mounted drives
ShellWhisperer: df -h | grep -v tmpfs | sort -k5 -hr

DevOps

User: List all running Docker containers with their ports
ShellWhisperer: docker ps --format "table {{.Names}}\t{{.Ports}}\t{{.Status}}"

Git Operations

User: Undo last commit but keep changes
ShellWhisperer: git reset --soft HEAD~1

Training Details

Parameter Value
Base Model Qwen2.5-0.5B
Training Shell command distillation from Fable5 traces
Context Window 32K tokens
License Apache 2.0

Use Cases

  • Terminal productivity booster
  • Shell command learning tool
  • System administration assistant
  • DevOps automation helper
  • Git workflow optimizer
  • Runs on phones for remote sysadmin

FableForge Family

Model Size Best For
ShellWhisperer 986MB Shell commands, ultra-fast
Mythos 9B 5.0GB All-rounder uncensored
Enhanced 5.0GB Perfect bypass + tools
Unhinged 5.0GB Max speed, zero filter
V2-8B 5.0GB Compact + reasoning
ReasonCritic-7B 3.1-16GB Reasoning + phone

Links

Part of the FableForge ecosystem — uncensored AI for everyone.