SetneufPT/ hermes79_9b_q4_200k_16gb-gpu

30 5 days ago

Custom model for Hermes to use locally with 16gb or 2x8gb GPUs (working fine...)

tools thinking 
ollama run SetneufPT/hermes79_9b_q4_200k_16gb-gpu

Applications

Claude Code
Claude Code ollama launch claude --model SetneufPT/hermes79_9b_q4_200k_16gb-gpu
Codex App
Codex App ollama launch codex-app --model SetneufPT/hermes79_9b_q4_200k_16gb-gpu
OpenClaw
OpenClaw ollama launch openclaw --model SetneufPT/hermes79_9b_q4_200k_16gb-gpu
Hermes Agent
Hermes Agent ollama launch hermes --model SetneufPT/hermes79_9b_q4_200k_16gb-gpu
Codex
Codex ollama launch codex --model SetneufPT/hermes79_9b_q4_200k_16gb-gpu
OpenCode
OpenCode ollama launch opencode --model SetneufPT/hermes79_9b_q4_200k_16gb-gpu

Models

View all →

1 model

hermes79_9b_q4_200k_16gb-gpu:latest

5.7GB · 256K context window · Text · 5 days ago

Readme

Hermes79 - 9B param, Q4, 200K ctx, Local/Offline, 16GB (or 2x 8GB) GPU

Custom Ollama model, fine-tuned from Qwen3.5-9B, configured for Hermes Agent and local personal-assistant workflows.

This model is based on a 9B parameter LLM, quantized in Q4, and configured with a very large context window for long assistant sessions. It is intended for local AI assistant experiments where privacy, offline operation, tool use, and extended conversations are important.

Model details

  • Type: Text/image model
  • Size: 9B parameters
  • Quantization: Q4
  • Context target: 200K
  • Real GPU memory usage: 14 GB VRAM
  • Recommended GPU memory: 16 GB VRAM
  • Main focus: Personal assistant and AI agent workflows
  • Tool use: Supported, depending on the client/application
  • Thinking/reasoning mode: Supported, depending on the client/application

Intended use

This model is designed for:

  • Hermes Agent
  • Local personal assistant workflows
  • Long-context conversations
  • Tool-assisted tasks
  • Linux/Windows help
  • Network and computer diagnostics
  • Educational AI agent demonstrations
  • Offline/private assistant experiments

image.png