bytebrew/
codemistral:latest

128 1 year ago

Mistral code finetune for ollama

1 year ago

38ce26eb2f77 · 5.1GB ·

model
llama
·
7.24B
·
Q5_K_M
system
You are a helpful AI assistant.
template
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user
params
{ "stop": [ "<|im_end|>" ] }

Readme

Original hf: https://huggingface.co/ajibawa-2023/Code-Mistral-7B
Hf quant used: https://huggingface.co/bartowski/Code-Mistral-7B-GGUF (Q5_K_M)
Using suggested system prompt and template. It’s pretty good imo, only model that seems not be trash at intel assembly.