10 4 days ago

Zion is a 12b parameter model with a 2 bit quantisation making it suitable for edge devices with minimal ram available. With a 1000K context making it ideal for coding. The model needs about 5.5 Gigabytes of Memory to run and the download is just a 4.8GB.

tools
ollama run PhysicsObsession/Zion-12b

Details

4 days ago

868f6ba4dbda · 4.8GB ·

llama
·
12.2B
·
Q2_K
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
{ "stop": [ "[INST]", "[/INST]" ] }
{{- range $i, $_ := .Messages }} {{- if eq .Role "user" }} {{- if and $.Tools (le (len (slice $.Mess

Readme

No readme