Thox-ai/ thox-cluster-swift:latest

8 10 months ago

A THOX configuration and distribution of Mistral AI's Ministral 3 8B, the smallest and lightest model in the MagStack cluster family, published for local inference and MeshStack deployments. Apache-2.0.

vision tools
... /
params
93c40560854a ยท 80B
{
"num_ctx": 32768,
"repeat_penalty": 1.1,
"temperature": 0.7,
"top_k": 40,
"top_p": 0.9
}