Supa-AI/ llama-7b-hf-32768-fpf

3 1 year ago

13 models

llama-7b-hf-32768-fpf:q3_k_s
8aeae31b50ad • 2.9GB • 32K context window •
Text input • 1 year ago
llama-7b-hf-32768-fpf:q3_k_m
5683ae2c0718 • 3.3GB • 32K context window •
Text input • 1 year ago
llama-7b-hf-32768-fpf:q3_k_l
3c6640ee3541 • 3.6GB • 32K context window •
Text input • 1 year ago
llama-7b-hf-32768-fpf:q4_0
651b01e829e9 • 3.8GB • 32K context window •
Text input • 1 year ago
llama-7b-hf-32768-fpf:q4_1
2db7d80cfdd2 • 4.2GB • 32K context window •
Text input • 1 year ago
llama-7b-hf-32768-fpf:q4_k_s
141b24808009 • 3.9GB • 32K context window •
Text input • 1 year ago
llama-7b-hf-32768-fpf:q4_k_m
93ccc9c27f11 • 4.1GB • 32K context window •
Text input • 1 year ago
llama-7b-hf-32768-fpf:q5_0
8bf9b5acb146 • 4.7GB • 32K context window •
Text input • 1 year ago
llama-7b-hf-32768-fpf:q5_1
01a75d6d4996 • 5.1GB • 32K context window •
Text input • 1 year ago
llama-7b-hf-32768-fpf:q5_k_s
e352616b9588 • 4.7GB • 32K context window •
Text input • 1 year ago
llama-7b-hf-32768-fpf:q5_k_m
c8949df2accf • 4.8GB • 32K context window •
Text input • 1 year ago
llama-7b-hf-32768-fpf:q6_k
2296c8ffd812 • 5.5GB • 32K context window •
Text input • 1 year ago
llama-7b-hf-32768-fpf:q8_0
617609c9c7f9 • 7.2GB • 32K context window •
Text input • 1 year ago