First upload of a huggingface model that has been quantized to use 4-bit weights (Q4_0).

9B

2 Pulls Updated 2 weeks ago

11c556ddc0f1 · 265B
[ { "role": "user", "content": "Is Toronto in Canada?" }, { "role": "assistant", "content": "yes" }, { "role": "user", "content": "Is Sacramento in Canada?" }, { "role": "assistant", "content": "no" }, { "role": "user", "content": "Is Ontario in Canada?" }, { "role": "assistant", "content": "yes" } ]