Thox-ai/ thox-pro-32b:latest

7 10 months ago

A THOX configuration and distribution of Alibaba Cloud's Qwen3 32B, the largest single-device model in the Pro family, published for local professional work. Apache-2.0.

... /
params
0c732914ed4c ยท 228B
{
"num_batch": 128,
"num_ctx": 128000,
"num_gpu": 99,
"num_predict": 16384,
"num_thread": 8,
"repeat_penalty": 1.1,
"stop": [
"<|endoftext|>",
"<|im_end|>",
"<|file_sep|>"
],
"temperature": 0.7,
"top_k": 40,
"top_p": 0.9
}