11 1 year ago

ollama run vrishankraina/vittyquantized

Details

1 year ago

22fddecade7a · 4.1GB

llama
·
6.74B
·
Q4_K_M
[INST] {{ .Prompt }} [/INST]
{ "num_ctx": 1024, "num_predict": 128, "repeat_penalty": 1.4, "stop": [ "[/I

Readme

No readme