slimsag / starchat2

Starchat 2

125 Pulls Updated 5 months ago

5 months ago

5a36458e440e · 32GB

model
starcoder2
·
16.0B
·
F16
template
{{ if .First }}<|system|> {{.System}}<|end|>{{ end }} <|user|> {{ .Prompt }}<|end|> <|assistant|>
params
{"num_ctx":16384,"stop":["<|end|>"]}

Readme

Starchat2 for Ollama

Starchat2 (15b v0.1) for Ollama:

Try it out

ollama run slimsag/starchat2:15b-v0.1-f16-q4_0 'How can I write a simple Python HTTP server that response to GET / with "hello world"?'

Quantized versions

The following models are available:

  • slimsag/starchat2:15b-v0.1-f16-q4_0 (recommended)
  • slimsag/starchat2:15b-v0.1-f16-q8_0
  • slimsag/starchat2:15b-v0.1-f16 (non-quantized)