Thox-ai/ thox-cluster-scout:latest

6 10 months ago

A THOX configuration and distribution of Alibaba Cloud's Qwen2.5 72B, published for local inference and MeshStack deployments at department scale. Qwen Research License (non-commercial).

... /
params
eb29f62e2e1d ยท 81B
{
"num_ctx": 131072,
"repeat_penalty": 1.1,
"temperature": 0.7,
"top_k": 40,
"top_p": 0.9
}