First upload of a huggingface model that has been quantized to use 4-bit weights (Q4_0).
2 Pulls Updated 2 months ago
11c556ddc0f1 · 265B
[{"role":"user","content":"Is Toronto in Canada?"},{"role":"assistant","content":"yes"},{"role":"user","content":"Is Sacramento in Canada?"},{"role":"assistant","content":"no"},{"role":"user","content":"Is Ontario in Canada?"},{"role":"assistant","content":"yes"}]