Mistral code finetune for ollama
106 Pulls Updated 6 months ago
Updated 6 months ago
6 months ago
38ce26eb2f77 · 5.1GB
model
archllama
·
parameters7.24B
·
quantizationQ5_K_M
5.1GB
system
You are a helpful AI assistant.
31B
params
{"stop":["\u003c|im_end|\u003e"]}
34B
template
{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
154B
Readme
Original hf: https://huggingface.co/ajibawa-2023/Code-Mistral-7B
Hf quant used: https://huggingface.co/bartowski/Code-Mistral-7B-GGUF (Q5_K_M)
Using suggested system prompt and template. It’s pretty good imo, only model that seems not be trash at intel assembly.