krith/
mistral-small-instruct-2409:IQ3_M

172 1 year ago

I-quants for mistral-small-instruct-2409

tools

1 year ago

f113a9158b24 · 10GB ·

model
llama
·
22.2B
·
IQ2_S
template
{{- if .Messages }} {{- range $index, $_ := .Messages }} {{- if eq .Role "user" }} {{- if and (le (l
license
# Mistral AI Research License If You want to use a Mistral Model, a Derivative or an Output for any
params
{ "stop": [ "[INST]", "[/INST]" ] }

Readme

Created using GGUF files from https://huggingface.co/bartowski/Mistral-Small-Instruct-2409-GGUF