SetneufPT/ Qwen3.6-27B-CODER-MTP_Q4_105k_24GB-GPU

32 23 hours ago

Custom model for coding with agents to use locally with 24gb GPUs (working very fine...)

vision tools thinking 
ollama run SetneufPT/Qwen3.6-27B-CODER-MTP_Q4_105k_24GB-GPU

Applications

Claude Code
Claude Code ollama launch claude --model SetneufPT/Qwen3.6-27B-CODER-MTP_Q4_105k_24GB-GPU
Codex App
Codex App ollama launch codex-app --model SetneufPT/Qwen3.6-27B-CODER-MTP_Q4_105k_24GB-GPU
OpenClaw
OpenClaw ollama launch openclaw --model SetneufPT/Qwen3.6-27B-CODER-MTP_Q4_105k_24GB-GPU
Hermes Agent
Hermes Agent ollama launch hermes --model SetneufPT/Qwen3.6-27B-CODER-MTP_Q4_105k_24GB-GPU
Codex
Codex ollama launch codex --model SetneufPT/Qwen3.6-27B-CODER-MTP_Q4_105k_24GB-GPU
OpenCode
OpenCode ollama launch opencode --model SetneufPT/Qwen3.6-27B-CODER-MTP_Q4_105k_24GB-GPU

Models

View all →

1 model

Qwen3.6-27B-CODER-MTP_Q4_105k_24GB-GPU:latest

18GB · 256K context window · Text, Image · 23 hours ago

Readme

Qwen 3.6 CODER MTP - 27B param, Q4, 105K ctx, Local/Offline, 24GB GPU

Custom Ollama model, fine-tuned from Qwen3.6 MTP 27B from unsloth, configured for local coding-agent workflows, especially with Open Code / Hermes.

This model is based on a 27B parameter LLM, quantized in Q4, with MTP and configured with a large context window for software development tasks. It is intended to provide a practical balance between performance, memory usage, and code-assistance quality on local hardware.

Model details

  • Type: Text model with MTP*
  • Size: 27B parameters
  • Quantization: Q4
  • Context target: 105K
  • Real GPU memory usage: 23,5 GB VRAM
  • Recommended GPU memory: 24 GB VRAM
  • Main focus: Coding and agentic development workflows
  • Tool use: Supported, depending on the client/application
  • Thinking/reasoning mode: Supported, depending on the client/application

Intended use

This model is designed for:

  • Agents workflows
  • Local coding assistants
  • Code analysis
  • Debugging support
  • Refactoring suggestions
  • Project exploration
  • Terminal-based programming tasks
  • Educational demonstrations of AI coding agents

* if runtime allows

image.png