An experimental 1.1B parameter model trained on the new Dolphin 2.8 dataset by Eric Hartford and based on TinyLlama.
1B
44.1K Pulls Updated 3 months ago
v2.8
637MB
1.1b-v2.8-q4_0
637MB
1.1b-v2.8-q4_1
701MB
1.1b-v2.8-q5_0
766MB
1.1b-v2.8-q5_1
831MB
1.1b-v2.8-q8_0
1.2GB
1.1b-v2.8-q2_K
432MB
1.1b-v2.8-q3_K_S
499MB
1.1b-v2.8-q3_K_M
548MB
1.1b-v2.8-q3_K_L
592MB
1.1b-v2.8-q4_K_S
640MB
1.1b-v2.8-q4_K_M
668MB
1.1b-v2.8-q5_K_S
766MB
1.1b-v2.8-q5_K_M
782MB
1.1b-v2.8-q6_K
903MB
1.1b-v2.8-fp16
2.2GB