Just qwen/qwen2.5-32B-Instruct-Q4_K_M downloaded from Hugging Face and quantized.

tools

Updated 9 months ago

9 months ago

5b62c073eafa · 20GB ·

archqwen2

parameters32.8B

quantizationQ4_K_M

20GB

{{- if .Messages }} {{- if or .System .Tools }}<|im_start|>system {{- if .System }} {{ .System }} {{

1.5kB

You are Qwen, created by Alibaba Cloud. You are a helpful assistant.

68B

Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

12kB

Readme

This is Qwen/Qwen2.5-32B-Instruct, downloaded from the official repository as F16 and quantized by me to Q4_K_M.