7 Downloads Updated 10 months ago
ollama run Thox-ai/thox-cluster-scout
Your AI. Your Data. Your Rules.™
NON-COMMERCIAL — Qwen Research License. The weights in this distribution are licensed under the Qwen Research License Agreement for non-commercial purposes only. Commercial use requires a separate license from Alibaba Cloud. See License before any use.
Thox-Cluster-Scout is a THOX configuration and distribution of Alibaba Cloud’s Qwen2.5 72B, published for local inference and MeshStack deployments at department scale. The weight layer in this model’s Ollama manifest is byte-identical to the upstream provider’s Ollama weight layer (qwen2.5:72b). THOX’s work in this release is the MeshStack clustering layer these configurations were made for, configuration (runtime parameters and a THOX system prompt), packaging, and distribution. THOX did not train these weights.
Correction notice. This page previously quoted cost-saving and productivity figures; those were inherited catalog copy with no THOX deployment evidence behind them and have been removed. No benchmark, throughput, latency, concurrency, uptime, cost-saving, or compliance figure is claimed for this release; figures of that kind that appeared on earlier versions of this page were inherited catalog copy and have been removed pending THOX-run evaluation on THOX deployments. Earlier versions of this page also stated MIT and marketed commercial deployment; both were incorrect (see License).
Ollama (published model)
ollama pull Thox-ai/thox-cluster-scout
ollama run Thox-ai/thox-cluster-scout
A THOX configuration and distribution of Qwen2.5 72B for local inference and MeshStack deployments at department scale: the department-scale tier of the MagStack family, between Cluster Small and Cluster Maverick. Configuration-derived: THOX did not train these weights. This distribution’s weight layer is identical to thox-cluster-secure’s (same SHA-256 digest); the two differ only in system prompt and presentation. Scout is the standard department configuration, Secure the security-focused one.
| Specification | Details |
|---|---|
| Base model | Qwen2.5 72B by Alibaba Cloud |
| Parameters | 72B, qwen2 family (upstream layer record) |
| Quantization | Q4_K_M (GGUF file_type in the manifest config) |
| Context window (served) | 131,072 tokens, from the params layer (num_ctx) in this model’s Ollama manifest. The Ollama page tag display of 32K is a display artifact and does not describe the served configuration. |
| Deployment | Local inference via Ollama; distributed orchestration via MeshStack (separate from this download) |
The published Ollama model Thox-ai/thox-cluster-scout is 47 GB.
Local inference through Ollama within the license terms below, on hardware that fits a 72B Q4-class model:
Local, on-premises inference on infrastructure you control. Downloading this model gives you local inference in Ollama. Distributed orchestration across devices is provided by MeshStack; a model download alone does not create a cluster or pool memory across devices.
No training by THOX. Base: Qwen/Qwen2.5-72B-Instruct by Alibaba Cloud, via Ollama tag qwen2.5:72b. The original THOX release materials for this model claim no separate THOX fine-tuning run, training dataset, or training procedure, and none is claimed here. Base-model training data and procedure are those of the base model’s provider; see the base model card for that record. Datasets added by THOX for this release: none.
No THOX-run evaluation has been published for this model, and no benchmark scores were published in the catalog summary for this model. THOX claims no benchmark, throughput, latency, or concurrency figure for this release. This section will be updated with method and results when a THOX-run evaluation lands.
Reference configuration from the original card, per device: minimum 64 GB RAM, 60 GB storage, NVIDIA Jetson Orin AGX class GPU (64GB VRAM), 10 Gbps network. Recommended 128 GB RAM, 100 GB NVMe SSD.
License warning. The model weights are distributed under the Qwen Research License Agreement (Alibaba Cloud, release date September 19, 2024), per the license layer in this model’s Ollama manifest (from the upstream qwen2.5:72b distribution). That license grants use for non-commercial purposes only; commercial use requires a separate license from Alibaba Cloud. Earlier versions of this page stated MIT and marketed commercial deployment; both were incorrect, and the MIT statement has been removed. THOX’s packaging material does not change the weights’ license, and no statement on any THOX page grants commercial rights in them.
MagStack and MeshStack technology is proprietary to Thox.ai LLC. Publication of this model does not license THOX mesh technology, patents, or trademarks beyond identifying the model.
THOX MeshStack Cluster family. First listed on Ollama under Thox-ai in 2025 and held private; publicly released 2026-10-31 by order of Tommy Xaypanya, CTO and Co-Founder of THOX.ai, as part of the MeshStack model family release. Upstream: Qwen/Qwen2.5-72B-Instruct, Ollama tag qwen2.5:72b; the weight layer is byte-identical to the upstream provider’s Ollama weight layer (SHA-256 verified in the 2026-10-31 release review) and identical to thox-cluster-secure’s weight layer. Model card: https://huggingface.co/Thox-ai/thox-cluster-scout. Correction history: inherited catalog claims (cost-saving, productivity and concurrency figures) removed and the license corrected from MIT to the Qwen Research License with the commercial marketing withdrawn, as recorded in the correction notice above. Enterprise: enterprise@thox.ai.