mannix/
smallthinker

87 8 months ago

A new small reasoning model fine-tuned from the Qwen 2.5 3B Instruct model. I-Quants models.

14 models

smallthinker:latest
4eed365cc9d6 • 2.0GB • 32K context window •
Text input • 8 months ago
smallthinker:q2_k
1c9d26e74519 • 1.4GB • 32K context window •
Text input • 8 months ago
smallthinker:q3_k_l
ed398d885a36 • 1.8GB • 32K context window •
Text input • 8 months ago
smallthinker:q4_0
4eed365cc9d6 • 2.0GB • 32K context window •
Text input • 8 months ago
smallthinker:q4_1
f2754c2bc16d • 2.2GB • 32K context window •
Text input • 8 months ago
smallthinker:q4_k_s
243ff25158be • 2.0GB • 32K context window •
Text input • 8 months ago
smallthinker:q5_0
57ac56b71f56 • 2.4GB • 32K context window •
Text input • 8 months ago
smallthinker:q5_1
6761063de4c3 • 2.6GB • 32K context window •
Text input • 8 months ago
smallthinker:q5_k_s
c70c9f60d82d • 2.4GB • 32K context window •
Text input • 8 months ago
smallthinker:q6_K
aadd902d2bda • 2.8GB • 32K context window •
Text input • 8 months ago
smallthinker:q8_0
0d8b89ef33da • 3.6GB • 32K context window •
Text input • 8 months ago
smallthinker:iq3_xxs
09b7ec7c70b2 • 1.4GB • 32K context window •
Text input • 8 months ago
smallthinker:iq3_s
59d722d9ed37 • 1.6GB • 32K context window •
Text input • 8 months ago
smallthinker:iq4_xs
319f0767136f • 1.9GB • 32K context window •
Text input • 8 months ago