slimsag/
starchat2:15b-v0.1-f16-q8_0

183 1 year ago

Starchat 2

1 year ago

0696f032b2ae · 17GB ·

model
starcoder2
·
16B
·
Q8_0
params
{ "num_ctx": 16384, "stop": [ "<|end|>" ] }
template
{{ if .First }}<|system|> {{.System}}<|end|>{{ end }} <|user|> {{ .Prompt }}<|end|> <|assistant|>

Readme

Starchat2 for Ollama

Starchat2 (15b v0.1) for Ollama:

Try it out

ollama run slimsag/starchat2:15b-v0.1-f16-q4_0 'How can I write a simple Python HTTP server that response to GET / with "hello world"?'

Quantized versions

The following models are available:

  • slimsag/starchat2:15b-v0.1-f16-q4_0 (recommended)
  • slimsag/starchat2:15b-v0.1-f16-q8_0
  • slimsag/starchat2:15b-v0.1-f16 (non-quantized)