second_constantine/
mistral-small-3.2:24b-UD-Q4_K_XL

136 2 days ago

An update to Mistral Small that improves on function calling, instruction following, and less repetition errors. (quantized UD-Q5_K_XL)

vision tools 24b

2 days ago

ea33b15b242d · 15GB

model
llama
·
23.6B
·
Q4_K_M
projector
clip
·
439M
·
F16
system
You are Mistral Small 3.2, a Large Language Model (LLM) created by Mistral AI, a French startup head
template
{{- range $index, $_ := .Messages }} {{- if eq .Role "system" }}[SYSTEM_PROMPT]{{ .Content }}[/SYSTE
params
{ "min_p": 0, "repeat_penalty": 1, "stop": [ "</s>" ], "temperature": 0.

Readme

Feature Value
vision not working
thinking false
tools true
Device Speed Version
RTX 3090 24gb ~44 token/s UD-Q5_K_XL
M1 Max 32gb ~15 token/s UD-Q5_K_XL