Supa-AI/
llama-7b-hf-32768-fpf

2 10 months ago

Models

View all →

13 models

llama-7b-hf-32768-fpf:q3_k_s

2.9GB · 32K context window · Text · 10 months ago

llama-7b-hf-32768-fpf:q3_k_m

3.3GB · 32K context window · Text · 10 months ago

llama-7b-hf-32768-fpf:q3_k_l

3.6GB · 32K context window · Text · 10 months ago

llama-7b-hf-32768-fpf:q4_0

3.8GB · 32K context window · Text · 10 months ago

llama-7b-hf-32768-fpf:q4_1

4.2GB · 32K context window · Text · 10 months ago

llama-7b-hf-32768-fpf:q4_k_s

3.9GB · 32K context window · Text · 10 months ago

llama-7b-hf-32768-fpf:q4_k_m

4.1GB · 32K context window · Text · 10 months ago

llama-7b-hf-32768-fpf:q5_0

4.7GB · 32K context window · Text · 10 months ago

llama-7b-hf-32768-fpf:q5_1

5.1GB · 32K context window · Text · 10 months ago

llama-7b-hf-32768-fpf:q5_k_s

4.7GB · 32K context window · Text · 10 months ago

llama-7b-hf-32768-fpf:q5_k_m

4.8GB · 32K context window · Text · 10 months ago

llama-7b-hf-32768-fpf:q6_k

5.5GB · 32K context window · Text · 10 months ago

llama-7b-hf-32768-fpf:q8_0

7.2GB · 32K context window · Text · 10 months ago

Readme

No readme