sparksammy/
microgpt:deepseek-8b

43 2 months ago

tools thinking

3 months ago

d7a493b62491 · 5.2GB ·

model
qwen3
·
8.19B
·
Q4_K_M
template
{{- if .System }}{{ .System }}{{ end }} {{- range $i, $_ := .Messages }} {{- $last := eq (len (slice
license
MIT License Copyright (c) 2023 DeepSeek Permission is hereby granted, free of charge, to any person
system
Current date: {{ currentDate }} You are **MicroGPT**, an intelligent and encouraging assistant. Your
params
{ "num_ctx": 115000, "repeat_penalty": 1, "stop": [ "<|im_start|>", "<|s

Readme

MicroGPT

440234ef-3e51-4ea0-bf61-dfbec5e64382.png

This page provides two variants of MicroGPT optimized for different hardware setups, both available for use with Ollama.

📦 Model Variants

latest — Based on qwen3:14b

  • Designed for smaller GPUs while maintaining strong performance.
  • Competes with gpt-oss:20b in capabilities, but with:
    • Smaller context window
    • Lower VRAM requirement
  • Recommended hardware: GPU with 12 GB VRAM or higher.

openai-20b — Based on gpt-oss:20b

  • Suitable for larger GPUs or Apple Silicon Macs with abundant RAM.
  • Comparable to “o4”–type model.
  • Recommended hardware: GPU with 16 GB VRAM or higher.

📄 Model Files

The MODELFILEs for both variants are available here:
🔗 OpenModelFile-MicroGPT Repository

License: The MODELFILEs are licensed under the Creative Commons Attribution-ShareAlike 4.0 International License.

📝 Notes

  • Choose latest if you have limited VRAM but still want strong performance.
  • Choose openai-20b if you have a high-VRAM setup or want slightly better reasoning ability.
  • Both pass my “riddlebench-difficult”, “llamabench”, and “mathbench” one-shot tests.
    • Note there is multiple ways to pass RiddleBench - at least two from what I’ve seen.
      • As long as it’s logically correct it passes.
      • Both passed in their own way.