LFM2.5-230M — Ollama Model (4-8 GB RAM) Ultra-Lightweight

Model: oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM

DESCRIPTION

LFM2.5-230M is a next-generation hybrid language model by Liquid AI, architecturally distinct from conventional transformers. It combines 8 double -gated Linear-Invariant-Valued (LIV) convolution blocks with 6 Grouped-Query Attention (GQA) blocks — a novel hybrid design that achieves 2-3x better perplexity per paramet er than dense transformers of equivalent size. This Ollama packaging uses the official BF16 GGUF quantization (~461 MB), bringing full model fidelity to the tightest hardware bud gets.

“Built to Run Anywhere.” — Liquid AI

The ideal lightweight AI companion for: 4 GB laptops · 8 GB desktops · Edge devices · Raspberry Pi 5 · Any system with limited RAM

Key Features

• Ultra-tiny footprint: only ~461 MB at BF16 full precision — runs on any 4 GB system including CPU-only
• Full precision: BF16 weights preserve 100% model quality (230M params, zero quantization loss)
• Blazing fast: 213 tok/s on Galaxy S25 Ultra, 42 tok/s on Raspberry Pi 5, 500+ tok/s on modern GPUs
• 16K context (configurable to 32K) — comfortable for multi-turn agentic conversations and data extraction
• Native tool calling: built-in <|tool_call_start|>, <|tool_call_end|> tokens for function calling
• Edge ready: explicitly designed for on-device deployment — trained with edge inference as a primary goal
• CPU-friendly: runs great on CPU-only hardware; works on Raspberry Pi 5 and smartphones
• 10 languages: EN, AR, ZH, FR, DE, IT, JA, KO, PT, ES
• LFM Open License v1.0: royalty-free for non-commercial/research and small business (<$10M annual revenue)

Architecture

REQUIREMENTS

Platform support: - CPU-only — runs on any modern CPU (230M model is tiny) - Any GPU (NVIDIA, AMD, Intel Arc, Apple Silicon) with 0.5 GB+ VRAM - Integrated GPU — Intel UHD, AMD Radeon Graphics (iGPU) all work - Raspberry Pi 5 — confirmed working at 42 tok/s - Smartphones — via termux/Ollama app - Edge devices — purpose-built for edge deployment

💡 Why 4-8 GB RAM? The model is ~461 MB. A 4 GB machine has ~2.5 GB of headroom — you can run this alongside your browser, IDE, and other applications without breaking a sweat. On 8 GB, you have ~6 GB headroom.

QUICK START

1. Install Ollama

# macOS (Homebrew)
brew install ollama

# Linux
curl -fsSL https://ollama.com/install.sh | sh

# Windows
# Download from https://ollama.com/download

2. Pull & Run

# Pull the model (downloads ~461 MB)
ollama pull oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM

# Run interactively
ollama run oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM

# Single prompt
ollama run oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM \
  "Extract all email addresses from this text: Contact us at support@example.com or sales@example.org"

USAGE

CLI

# Interactive chat
ollama run oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM

# With system prompt
ollama run oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM \
  --system "You are a data extraction assistant. Extract structured data from unstructured text."

# Override context for 8 GB systems
ollama run oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM \
  --num-ctx 32768

REST API

# Chat completion
curl -s http://127.0.0.1:11434/api/chat \
  -d '{
    "model": "oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM",
    "messages": [{"role": "user", "content": "What is the capital of France?"}]
  }'

# Data extraction
curl -s http://127.0.0.1:11434/api/chat \
  -d '{
    "model": "oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM",
    "messages": [
      {"role": "user", "content": "Extract all dates and amounts from: Invoice dated 2024-03-15 for $1,234.56"}
    ],
    "options": {
      "temperature": 0.1,
      "top_k": 50
    }
  }'

# Tool calling
curl -s http://127.0.0.1:11434/api/chat \
  -d '{
    "model": "oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM",
    "messages": [{"role": "user", "content": "What is the weather in Boston?"}],
    "tools": [
      {
        "type": "function",
        "function": {
          "name": "get_weather",
          "description": "Get the current weather for a city",
          "parameters": {
            "type": "object",
            "properties": {
              "location": {"type": "string", "description": "City name"}
            },
            "required": ["location"]
          }
        }
      }
    ]
  }'

# OpenAI-compatible endpoint
curl -s http://127.0.0.1:11434/v1/chat/completions \
  -d '{
    "model": "oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM",
    "messages": [{"role": "user", "content": "Hello!"}],
    "stream": false
  }'

Python (ollama library)

pip install ollama

import ollama

# Chat
response = ollama.chat(
    model='oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM',
    messages=[{'role': 'user', 'content': 'Extract all names from this text: John Doe and Jane Smith were present.'}],
)
print(response.message.content)

# Tool calling
response = ollama.chat(
    model='oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM',
    messages=[{'role': 'user', 'content': 'What is the weather in Boston?'}],
    tools=[{
        'type': 'function',
        'function': {
            'name': 'get_weather',
            'description': 'Get current weather',
            'parameters': {
                'type': 'object',
                'properties': {
                    'location': {'type': 'string', 'description': 'City name'}
                },
                'required': ['location']
            }
        }
    }],
)
print(response.message.tool_calls)

JavaScript (ollama.js)

npm install ollama

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM',
  messages: [{ role: 'user', content: 'Extract the date from: The meeting is on 2024-06-15.' }],
})
console.log(response.message.content)

SAMPLING PARAMETERS

These are baked into the model via its Modelfile:

Equivalent llama.cpp Command

./llama-cli \
  -m LFM2.5-230M-BF16.gguf \
  -ngl 99 \
  -c 16384 \
  --temp 0.1 \
  --top-k 50 \
  --repeat-penalty 1.05 \
  -cnv

Override for More Creative Tasks

If you need less deterministic outputs (e.g., for creative text generation):

ollama run oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM \
  --temperature 0.7 --top-p 0.95

MEMORY & PERFORMANCE

RAM Budget

Context Window Scaling (4 GB, with q8_0 KV cache)

Performance

TROUBLESHOOTING

Optimizations for 4 GB Systems

# Set KV cache to q8_0 for ~50% memory reduction
export OLLAMA_KV_CACHE_TYPE=q8_0
ollama serve

# In another terminal:
ollama run oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM

# Or reduce context at runtime:
ollama run oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM --num-ctx 8192

ALTERNATIVE MODELS

# Larger coding model (needs 16 GB)
ollama pull oamazonasgabriel/qwen3.5-9b:q4-16gbGPU

# Larger MoE model (needs 24 GB)
ollama pull oamazonasgabriel/qwen3.6-35b-a3b:q4-24gbGPU

# Similar lightweight model (FIM-optimized, 0.5B, 8 GB)
ollama pull oamazonasgabriel/qwen2.5-coder-0.5b:fp16-8gbGPU

# Even smaller 4-bit version of this model
ollama pull hf.co/LiquidAI/LFM2.5-230M-GGUF:Q4_K_M

CREDITS

This Ollama packaging brings together work from multiple teams and individuals:

Citation

If you use this model in your work, please cite the original LFM2 technical report:

@article{liquidai2025lfm2,
  title={LFM2 Technical Report},
  author={Liquid AI},
  journal={arXiv preprint arXiv:2511.23404},
  year={2025}
}

@article{liquidAI2026230M,
  author = {Liquid AI},
  title = {LFM2.5-230M: Built to Run Anywhere},
  journal = {Liquid AI Blog},
  year = {2026},
  note = {www.liquid.ai/blog/lfm2-5-230m}
}

Acknowledgments

• The llama.cpp project (github.com/ggerganov/llama.cpp) for the GGUF format and efficient inference engine that makes models like t his accessible on commodity hardware.
• The Ollama team (ollama.com) for the seamless model distribution platform.
• Hugging Face (huggingface.co) for model hosting and the Hub ecosystem.

LINKS