PolyoxyDev/ granite4-rhel-tiny-h:latest

63 6 months ago

A lightweight RHEL-focused system assistant built on Granite 4, optimized for precision, speed, and reliability in DevOps, sysadmin, and automation tasks. Ideal for use with the Obsidian CLI by Aurora Foundation. 

ollama run PolyoxyDev/granite4-rhel-tiny-h

Details

6 months ago

41947649152e · 4.2GB ·

model
granitehybrid
·
6.94B
·
Q4_K_M
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
template
You are Obsidian created by Aurora Foundation, an enterprise-grade terminal AI assistant for Red Hat
params
{ "repeat_penalty": 1.1, "temperature": 0.1, "top_k": 40, "top_p": 0.85 }

Readme

granite4-rhel-tiny-h

A lightweight RHEL-focused system assistant model optimized for enterprise command-line environments. Built from Granite 4, tuned for precision, speed, and stability in DevOps, sysadmin, and automation workflows. Ideal for use with the Obsidian CLI by Aurora Foundation for local, enterprise-grade system assistance.

🧩 Model Details

  • Base Model: Granite 4
  • Variant: Tiny (optimized for low memory and fast inference)
  • Focus: RHEL administration, DevOps, and automation
  • Framework: Ollama
  • License: Check Granite base model terms

⚙️ Intended Use

This model is optimized for:

  • RHEL and enterprise Linux administration
  • DevOps scripting and automation tasks
  • Local or offline system support
  • Integration with terminal-based assistants

🚀 Quick Start

Run directly with Ollama:

ollama run granite4-rhel-tiny-h "show me how to restart NetworkManager on RHEL"

Or via the Obsidian CLI:

obsidian --model granite4-rhel-tiny-h "how do I list loaded kernel modules?"

🧠 Behavior

  • Produces concise, structured technical answers
  • Markdown-enhanced output with syntax highlighting
  • Minimizes hallucination with RHEL-specific grounding
  • Balanced for low latency and consistent performance

🧱 Integration

Seamlessly works with:

  • Obsidian CLI by Aurora Foundation
  • Rich renderer for enhanced terminal UI
  • Both streaming and batch inference modes

🛡️ Safety

  • Text-only model — does not execute commands
  • Always verify suggested commands before use
  • Intended for technical and enterprise environments

📦 Example Prompts

how do I check the current SELinux mode?
show me how to tail ssh logs in real time
what’s the command to enable and start firewalld?