SetneufPT/ Qwen3.8-27B_Q4_100k_24GB-GPU:latest

34 2 days ago

Custom model for coding with agents to use locally with 24gb GPUs - BEST FOR OPENCODE!

vision tools thinking 
ollama run SetneufPT/Qwen3.8-27B_Q4_100k_24GB-GPU

Details

2 days ago

d881b24a875b · 18GB ·

model
qwen35
·
27.3B
·
Q4_K_M
projector
clip
·
461M
·
BF16
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
params
{ "draft_num_predict": 4, "min_p": 0, "num_ctx": 100000, "num_gpu": 999, "presen

Readme

Qwen 3.8 - 27B param, Q4, 100K ctx, Local/Offline, 24GB GPU

Custom Ollama model, fine-tuned from Qwen3.8, configured for local coding-agent workflows, especially with Open Code / Hermes.

This model is based on a 27B parameter LLM, quantized in Q4 and configured with a large context window for software development tasks. It is intended to provide a practical balance between performance, memory usage, and code-assistance quality on local hardware.

Model details

  • Type: Text/vision model
  • Size: 27B parameters
  • Quantization: Q4
  • Context target: 100K
  • Real GPU memory usage: 23,5 GB VRAM
  • Recommended GPU memory: 24 GB VRAM
  • Main focus: Coding and agentic development workflows
  • Tool use: Supported, depending on the client/application
  • Thinking/reasoning mode: Supported, depending on the client/application

Intended use

This model is designed for:

  • Agents workflows
  • Local coding assistants
  • Code analysis
  • Debugging support
  • Refactoring suggestions
  • Project exploration
  • Terminal-based programming tasks
  • Educational demonstrations of AI coding agents

image.png