185 2 years ago

Quantized version of IlyaGusev/saiga_gemma2_9b created by QuantFactory

ollama run akdengi/saiga-gemma2

Details

2 years ago

4afec87e2514 · 5.8GB

gemma2
·
9.24B
·
Q4_K_M
{ "num_keep": 24, "stop": [ "<|start_header_id|>", "<|end_header_id|>",
<start_of_turn>user {{ if .System }}{{ .System }} {{ end }}{{ .Prompt }}<end_of_turn> <start_of_turn

Readme

No readme