97 Downloads Updated 10 months ago
Name
3 models
Size
Context
Input
qwen2.5-3b-instruct:Q4_K_M
1.9GB · 32K context window · Text · 10 months ago
1.9GB
32K
Text
qwen2.5-3b-instruct:Q8_0
3.3GB · 32K context window · Text · 10 months ago
3.3GB
qwen2.5-3b-instruct:F16
6.2GB · 32K context window · Text · 10 months ago
6.2GB
Model Reference: https://huggingface.co/Qwen/Qwen2.5-3B-Instruct