did100/
qwen2.5-32B-Instruct-Q4_K_M

309 9 months ago

Just qwen/qwen2.5-32B-Instruct-Q4_K_M downloaded from Hugging Face and quantized.

tools

Models

View all →

1 model

qwen2.5-32B-Instruct-Q4_K_M:latest

20GB · 32K context window · Text · 9 months ago

Readme

Model information

This is Qwen/Qwen2.5-32B-Instruct, downloaded from the official repository as F16 and quantized by me to Q4_K_M.