krith/
qwen2.5-72b-instruct

406 1 year ago

I-quants for qwen2.5-72b-instruct

tools

Models

View all →

11 models

qwen2.5-72b-instruct:IQ3_M

36GB · 32K context window · Text · 1 year ago

qwen2.5-72b-instruct:IQ1_S

23GB · 32K context window · Text · 1 year ago

qwen2.5-72b-instruct:IQ1_M

24GB · 32K context window · Text · 1 year ago

qwen2.5-72b-instruct:IQ2_XXS

25GB · 32K context window · Text · 1 year ago

qwen2.5-72b-instruct:IQ2_XS

27GB · 32K context window · Text · 1 year ago

qwen2.5-72b-instruct:IQ2_S

28GB · 32K context window · Text · 1 year ago

qwen2.5-72b-instruct:IQ2_M

29GB · 32K context window · Text · 1 year ago

qwen2.5-72b-instruct:IQ3_XXS

32GB · 32K context window · Text · 1 year ago

qwen2.5-72b-instruct:IQ3_XS

33GB · 32K context window · Text · 1 year ago

qwen2.5-72b-instruct:IQ3_S

34GB · 32K context window · Text · 1 year ago

qwen2.5-72b-instruct:IQ4_XS

40GB · 32K context window · Text · 1 year ago

Readme

Created using GGUF files from https://huggingface.co/ThomasBaruzier/Qwen2.5-72B-Instruct-GGUF