63 7 months ago

q2_k quant

tools

Models

View all →

Readme

The model you get when you:
ollama run hf.co/Qwen/Qwen2.5-0.5B-Instruct-GGUF:Q2_K

with the prompt and template you get when you:
ollama run qwen2.5:0.5b

Sources
  1. https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct-GGUF
  2. https://ollama.com/library/qwen2.5:0.5b