sparksammy/
microcoder:8b

59 2 months ago

8b

2 months ago

63f91e100563 · 5.2GB ·

model
qwen3
·
8.19B
·
Q4_K_M
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
system
You are **MicroCoder**, a highly capable and responsible AI coding assistant, created by **MyMel2001
params
{ "num_ctx": 5432, "repeat_penalty": 1.05, "stop": [ "<|im_start|>", "<|
template
{{- if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }} {{- range $i, $_ := .Messages

Readme

Project Overview: Hybrid Model Integration

This project focuses on building a hybrid language model by combining the strengths of two components:

  • The Qwen3 base model, which is optimized for running on consumer-grade hardware, and
  • The parameters (PARAMETERS) and formatting logic (TEMPLATE) of Qwen3-Coder, designed specifically for code-centric use cases.

Additionally, a custom SYSTEM prompt is layered in to influence the tone, formatting, and style of interactions — without modifying the model weights or training data.

  • “latest” tag is the 14b model
  • “8b” tag is the 8b model

Key Components

1. Qwen3 Base Model

  • Optimized for efficient local deployment.
  • Performs well on consumer-grade GPUs.
  • Modular and compatible with adapter-based fine-tuning workflows.
  • Available in multiple quantized formats for resource-aware setups.

2. Qwen3-Coder Parameters

  • Builds upon Qwen3 with instruction tuning focused on software development tasks.
  • Enhanced to handle tasks such as:
    • Code generation
    • Bug fixing
    • Language-to-code translation
    • Contextual code reasoning
  • Parameters are fine-tuned to prioritize correctness and clarity, especially in ambiguous or underspecified prompts.

3. Custom SYSTEM Prompt

  • A static prompt that is prepended to each session to shape the model’s behavior without changing the model weights.
  • It handles:
    • Adjusting tone (e.g., concise, verbose, formal)
    • Influencing structure (e.g., Markdown usage, headings, bullet points)
    • Enhancing user interaction style (e.g., reasoning before answering)
    • Prompt formatting that excels in:
      • Code generation
      • Bug fixing
      • Inline explanations
      • Multi-language support

4. MODELFILE for Ollama

  • The integration is driven by a MODELFILE compatible with Ollama, a local LLM runtime.
  • Licensed under Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0):
    • Allows redistribution and modification,
    • Requires attribution,
    • Mandates that derivative works share the same license.
  • The MODELFILE includes:
    • Base model reference and adapter merges,
    • Role and message formatting for system/user/assistant prompts (the TEMPLATE),
    • Runtime configurations such the base model (Qwen3) and the SYSTEM prompt.
  • Note: The MODELFILE defines runtime behavior and formatting but does not embed personal workflows or preferences.

Final Goal

The aim is to deliver a high-performance, locally deployable code assistant that blends:

  • The efficiency and portability of Qwen3,
  • The domain specialization of Qwen3-Coder,
  • A flexible and user-controllable SYSTEM prompt interface.

This hybrid model offers a practical solution for developers who want local execution, prompt-level control, and open licensing — without compromising on programming-specific capabilities.