SetneufPT/ Ornith-1.0-35B-MOE_Q4_200k_32GB-GPU:latest

131 3 months ago

Custom model for coding with agents to use locally with 32gb, 2x16gb or 5x8gb GPUs (working very well!!)

tools
... /
template
64631f1262e4 ยท 181B
{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{ end }}<|im_start|>assistant
{{ .Response }}<|im_end|>