16 Downloads Updated 4 months ago
ollama run banaxitech/bananamind-v1
Updated 4 months ago
4 months ago
0890bbf98dc4 · 271MB ·
A small, local, and honestly not very good 125M parameter language model — but it runs fast, fits anywhere, and it’s yours.
⚠️ Fair warning: This is a personal project model. It will hallucinate, forget things after 512 tokens, and occasionally say something completely unhinged. You have been warned.
ollama run banaxitech/bananamind-v1
That’s it. No GPU required.
BananaMind V1 is a tiny conversational model fine-tuned on the OpenAssistant oasst1 dataset. It uses the ChatML prompt format and is designed for local, CPU-friendly inference.
| Property | Value |
|---|---|
| Parameters | 125M |
| Context Window | 512 tokens |
| Format | GGUF |
| License | Apache 2.0 |
| Prompt Format | ChatML |
If you’re building on top of this model or tweaking settings, here’s the full Modelfile:
FROM ./BananaMind-V1.gguf
TEMPLATE """<|im_start|>system
You are a helpful assistant.<|im_end|>
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
"""
PARAMETER top_p 0.9
PARAMETER stop <|im_end|>
PARAMETER temperature 0.8
PARAMETER top_k 50
The newlines inside the
TEMPLATEblock must be real newlines, andstopmust be set without quotes.
temperature = more creative (and more unhinged)Apache 2.0 — free to use, modify, and distribute.
Small model. Big dreams. Low bar. 🍌