richardyoung/
kimi-vl-a3b-thinking:Q5_K_M

43 2 days ago

Kimi-VL-A3B-Thinking is a powerful vision-language model from Moonshot AI featuring extended thinking capabilities. Built on the DeepSeek2 architecture with Mixture of Experts (MoE), it excels at complex visual reasoning tasks, mathematical problem-s

... /
license
123a57f01e75 · 821B
# Kimi-VL-A3B-Thinking Q5_K_M: Advanced Vision-Language Model with Extended Reasoning
## Overview
Kimi-VL-A3B-Thinking Q5_K_M quantization - Balanced quality and size.
## Available Versions
| Tag | Size | Description |
|-----|------|-------------|
| `q8_0` | 16 GB | Near-full precision |
| `q6_k` | 13 GB | High quality |
| `q5_k_m` | 11 GB | Balanced quality/size |
| `q4_k_m` | 9.8 GB | Recommended - best quality/size ratio |
| `iq4_xs` | 8.2 GB | Smallest quantization |
| `f16` | 30 GB | Full precision |
## Links
- **Original Model**: [moonshotai/Kimi-VL-A3B-Thinking-2506](https://huggingface.co/moonshotai/Kimi-VL-A3B-Thinking-2506)
- **GGUF Files**: [richardyoung/Kimi-VL-A3B-Thinking-GGUF](https://huggingface.co/richardyoung/Kimi-VL-A3B-Thinking-GGUF)
MIT License - Free for commercial and personal use.