krith

I-quants for those of us in VRAM poverty.

qwen2.5-coder-32b-instruct

I-quants for qwen2.5-coder-32b-instruct

tools

1,876 Pulls 8 Tags Updated 9 months ago
qwen2.5-14b-instruct

I-quants for qwen2.5-14b-instruct

tools

638 Pulls 11 Tags Updated 11 months ago
qwen2.5-7b-instruct

I-quants for qwen2.5-7b-instruct

tools

630 Pulls 11 Tags Updated 11 months ago
meta-llama-3.2-1b-instruct-uncensored

I-quants for meta-llama-3.2-1b-instruct-uncensored

tools

556 Pulls 4 Tags Updated 11 months ago
meta-llama-3.2-3b-instruct-uncensored

I-quants for meta-llama-3.2-3b-instruct-uncensored

tools

543 Pulls 4 Tags Updated 11 months ago
qwen2.5-32b-instruct

I-quants for qwen2.5-32b-instruct

tools

460 Pulls 11 Tags Updated 11 months ago
llama-3.3-70b-instruct

I-quants for llama-3.3-70b-instruct

tools

417 Pulls 11 Tags Updated 8 months ago
qwen2.5-72b-instruct

I-quants for qwen2.5-72b-instruct

tools

380 Pulls 11 Tags Updated 11 months ago
mistral-nemo-instruct-2407-abliterated

I-quants for mistral-nemo-instruct-2407-abliterated

tools

379 Pulls 4 Tags Updated 11 months ago
phi-3.5-mini-instruct_uncensored

I-quants for phi-3.5-mini-instruct_uncensored

361 Pulls 4 Tags Updated 11 months ago
qwen2.5-coder-32b-instruct-abliterated

I-quants for qwen2.5-coder-32b-instruct-abliterated

tools

261 Pulls 6 Tags Updated 9 months ago
qwen2.5-coder-14b-instruct

I-quants for qwen2.5-coder-14b-instruct

tools

259 Pulls 6 Tags Updated 9 months ago
meta-llama-3.1-70b-instruct-abliterated

I-quants for meta-llama-3.1-70b-instruct-abliterated

tools

231 Pulls 6 Tags Updated 11 months ago
llama-3.1-nemotron-70b-instruct-hf

I-quants for llama-3.1-nemotron-70b-instruct-hf

tools

223 Pulls 7 Tags Updated 10 months ago
gemma-2-2b-it-abliterated

I-quants for gemma-2-2b-it-abliterated

215 Pulls 4 Tags Updated 11 months ago
meta-llama-3.1-8b-instruct

I-quants for meta-llama-3.1-8b-instruct

tools

183 Pulls 11 Tags Updated 11 months ago
mistral-small-instruct-2409

I-quants for mistral-small-instruct-2409

tools

168 Pulls 6 Tags Updated 11 months ago
mistral-large-instruct-2407

I-quants for mistral-large-instruct-2407

tools

158 Pulls 7 Tags Updated 11 months ago
gemma-2-9b-it-abliterated

I-quants for gemma-2-9b-it-abliterated

157 Pulls 4 Tags Updated 11 months ago
meta-llama-3.1-8b-instruct-abliterated

I-quants for meta-llama-3.1-8b-instruct-abliterated

tools

156 Pulls 4 Tags Updated 11 months ago
qwen2.5.1-coder-7b-instruct

I-quants for qwen2.5.1-coder-7b-instruct

tools

155 Pulls 4 Tags Updated 9 months ago
qwen2.5-coder-14b-instruct-abliterated

I-quants for qwen2.5-coder-14b-instruct-abliterated

tools

77 Pulls 6 Tags Updated 9 months ago
phi-3.5-mini-instruct

I-quants for phi-3.5-mini-instruct

74 Pulls 4 Tags Updated 11 months ago
qwen2.5-coder-7b-instruct-abliterated

I-quants for qwen2.5-coder-7b-instruct-abliterated

tools

40 Pulls 4 Tags Updated 9 months ago

I-quants for those of us in VRAM poverty.

qwen2.5-coder-32b-instruct

qwen2.5-14b-instruct

qwen2.5-7b-instruct

meta-llama-3.2-1b-instruct-uncensored

meta-llama-3.2-3b-instruct-uncensored

qwen2.5-32b-instruct

llama-3.3-70b-instruct

qwen2.5-72b-instruct

mistral-nemo-instruct-2407-abliterated

phi-3.5-mini-instruct_uncensored

qwen2.5-coder-32b-instruct-abliterated

qwen2.5-coder-14b-instruct

meta-llama-3.1-70b-instruct-abliterated

llama-3.1-nemotron-70b-instruct-hf

gemma-2-2b-it-abliterated

meta-llama-3.1-8b-instruct

mistral-small-instruct-2409

mistral-large-instruct-2407

gemma-2-9b-it-abliterated

meta-llama-3.1-8b-instruct-abliterated

qwen2.5.1-coder-7b-instruct

qwen2.5-coder-14b-instruct-abliterated

phi-3.5-mini-instruct

qwen2.5-coder-7b-instruct-abliterated