SetneufPT/ Qwopus3.6-27B-MTP_Q2_32K_16GB-GPU:latest

111 1 month ago

Custom model for coding with agents to use locally with 16gb or 2x8gb GPUs (working...) 

ollama run SetneufPT/Qwopus3.6-27B-MTP_Q2_32K_16GB-GPU

Details

1 month ago

826f5e82734b · 11GB ·

model
qwen35
·
27.3B
·
Q2_K
system
You are a coding agent. Be concise. Avoid loops. Use tools only when necessary. Do not repeat the sa
license
Credits to Jackrong. Base model: Qwopus3.6 27B v2 MTP Original model: Qwen3.6 27B
params
{ "num_ctx": 32000, "repeat_last_n": 4096, "repeat_penalty": 1.1, "seed": 79, "t

Readme

Qwopus 3.6 MTP - 27B param, Q2, 32K ctx, Local/Offline, 16GB (or 2x 8GB) GPU

Custom Ollama model, fine-tuned from Qwopus3.6 MTP 27B (reasoning distillation from Opus) from Jackrong, configured for local coding-agent workflows, especially with Claude Code.

This model is based on a 27B parameter LLM, quantized in Q2, with MTP and configured with a large context window for software development tasks. It is intended to provide a practical balance between performance, memory usage, and code-assistance quality on local hardware.

Model details

  • Type: Text model with MTP*
  • Size: 27B parameters
  • Quantization: Q2
  • Context target: 32K
  • Real GPU memory usage: 13 GB VRAM
  • Recommended GPU memory: 16 GB VRAM
  • Main focus: Coding and agentic development workflows
  • Tool use: Supported, depending on the client/application
  • Thinking/reasoning mode: Supported, depending on the client/application

Intended use

This model is designed for:

  • Agents workflows

  • Local coding assistants

  • Code analysis

  • Debugging support

  • Refactoring suggestions

  • Project exploration

  • Terminal-based programming tasks

  • Educational demonstrations of AI coding agents

  • if runtime allows

image.png