gbenson/
qwen2.5-0.5b-instruct:Q2_K

146 9 months ago

q2_k quant

tools

9 months ago

ac7653a739b5 · 415MB ·

model
qwen2
·
630M
·
Q2_K
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
template
{{- if .Messages }} {{- if or .System .Tools }}<|im_start|>system {{- if .System }} {{ .System }} {{
system
You are Qwen, created by Alibaba Cloud. You are a helpful assistant.

Readme

The model you get when you:
ollama run hf.co/Qwen/Qwen2.5-0.5B-Instruct-GGUF:Q2_K

with the prompt and template you get when you:
ollama run qwen2.5:0.5b

Sources
  1. https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct-GGUF
  2. https://ollama.com/library/qwen2.5:0.5b