NeuralNet / openchat-3.6

openchat-3.6 model optimized to GGUF by NeuralNet. 100% compatible with Ollama

8B

214 Pulls Updated 2 months ago

17 Tags

6e9ef18fda70 • 4.7GB • Updated 2 months ago

latest

6e9ef18fda70 • 4.7GB • Updated 2 months ago

8b-20240522-fp16

b95344821937 • 16GB • Updated 2 months ago

8b-20240522-q2_K

07bf5a8cba7f • 3.2GB • Updated 2 months ago

8b-20240522-q3_K_S

bdbcd6ad6f2a • 3.7GB • Updated 2 months ago

8b-20240522-q3_K_M

80f9474035f0 • 4.0GB • Updated 2 months ago

8b-20240522-q3_K_L

202636b165c5 • 4.3GB • Updated 2 months ago

8b-20240522-q4_0

ab4b2e7ab50b • 4.7GB • Updated 2 months ago

8b-20240522-q4_1

71c7b434e2db • 5.1GB • Updated 2 months ago

8b-20240522-q4_K_S

7eb56940e707 • 4.7GB • Updated 2 months ago

8b-20240522-q4_K_M

48205c4286fd • 4.9GB • Updated 2 months ago

8b-20240522-q5_0

17ddc729b947 • 5.6GB • Updated 2 months ago

8b-20240522-q5_1

0925c1a209f7 • 6.1GB • Updated 2 months ago

8b-20240522-q5_K_S

85c09e2eb989 • 5.6GB • Updated 2 months ago

8b-20240522-q5_K_M

354c3d52e67d • 5.7GB • Updated 2 months ago

8b-20240522-q6_K

566979ed51fa • 6.6GB • Updated 2 months ago

8b-20240522-q8_0

399adee563dd • 8.5GB • Updated 2 months ago