7 10 months ago

A THOX configuration and distribution of Alibaba Cloud's Qwen2.5 72B, published for local inference and MeshStack deployments at department scale. Qwen Research License (non-commercial).

ollama run Thox-ai/thox-cluster-scout

Models

View all →

Readme

Thox-Cluster-Scout — Department-Scale Configuration (Qwen2.5 72B, THOX-Configured)

License Params Base Access

Your AI. Your Data. Your Rules.™

NON-COMMERCIAL — Qwen Research License. The weights in this distribution are licensed under the Qwen Research License Agreement for non-commercial purposes only. Commercial use requires a separate license from Alibaba Cloud. See License before any use.

Thox-Cluster-Scout is a THOX configuration and distribution of Alibaba Cloud’s Qwen2.5 72B, published for local inference and MeshStack deployments at department scale. The weight layer in this model’s Ollama manifest is byte-identical to the upstream provider’s Ollama weight layer (qwen2.5:72b). THOX’s work in this release is the MeshStack clustering layer these configurations were made for, configuration (runtime parameters and a THOX system prompt), packaging, and distribution. THOX did not train these weights.

Correction notice. This page previously quoted cost-saving and productivity figures; those were inherited catalog copy with no THOX deployment evidence behind them and have been removed. No benchmark, throughput, latency, concurrency, uptime, cost-saving, or compliance figure is claimed for this release; figures of that kind that appeared on earlier versions of this page were inherited catalog copy and have been removed pending THOX-run evaluation on THOX deployments. Earlier versions of this page also stated MIT and marketed commercial deployment; both were incorrect (see License).

Run it

Ollama (published model)

ollama pull Thox-ai/thox-cluster-scout
ollama run Thox-ai/thox-cluster-scout

Summary

A THOX configuration and distribution of Qwen2.5 72B for local inference and MeshStack deployments at department scale: the department-scale tier of the MagStack family, between Cluster Small and Cluster Maverick. Configuration-derived: THOX did not train these weights. This distribution’s weight layer is identical to thox-cluster-secure’s (same SHA-256 digest); the two differ only in system prompt and presentation. Scout is the standard department configuration, Secure the security-focused one.

Specification Details
Base model Qwen2.5 72B by Alibaba Cloud
Parameters 72B, qwen2 family (upstream layer record)
Quantization Q4_K_M (GGUF file_type in the manifest config)
Context window (served) 131,072 tokens, from the params layer (num_ctx) in this model’s Ollama manifest. The Ollama page tag display of 32K is a display artifact and does not describe the served configuration.
Deployment Local inference via Ollama; distributed orchestration via MeshStack (separate from this download)

The published Ollama model Thox-ai/thox-cluster-scout is 47 GB.

Intended use

Local inference through Ollama within the license terms below, on hardware that fits a 72B Q4-class model:

  • Research and evaluation of large-model local inference at department scale
  • Non-commercial evaluation of MeshStack device pooling with a 72B-class model
  • Document analysis and team knowledge work within the license terms below

Local, on-premises inference on infrastructure you control. Downloading this model gives you local inference in Ollama. Distributed orchestration across devices is provided by MeshStack; a model download alone does not create a cluster or pool memory across devices.

Training data and procedure

No training by THOX. Base: Qwen/Qwen2.5-72B-Instruct by Alibaba Cloud, via Ollama tag qwen2.5:72b. The original THOX release materials for this model claim no separate THOX fine-tuning run, training dataset, or training procedure, and none is claimed here. Base-model training data and procedure are those of the base model’s provider; see the base model card for that record. Datasets added by THOX for this release: none.

Evaluation

No THOX-run evaluation has been published for this model, and no benchmark scores were published in the catalog summary for this model. THOX claims no benchmark, throughput, latency, or concurrency figure for this release. This section will be updated with method and results when a THOX-run evaluation lands.

Hardware Reference (from the original card)

Reference configuration from the original card, per device: minimum 64 GB RAM, 60 GB storage, NVIDIA Jetson Orin AGX class GPU (64GB VRAM), 10 Gbps network. Recommended 128 GB RAM, 100 GB NVMe SSD.

Limitations

  • Outputs can be wrong. Professional, medical, legal, financial, and security-relevant outputs require qualified human review.
  • Local deployment only in this distribution; behavior and speed depend entirely on the operator’s hardware and configuration.
  • The operator is responsible for meeting any regulatory obligations that apply to their deployment.
  • 72B-class hardware requirements. All processing is local by design; the model has no access to online information or external services unless the operator wires them in.

License

License warning. The model weights are distributed under the Qwen Research License Agreement (Alibaba Cloud, release date September 19, 2024), per the license layer in this model’s Ollama manifest (from the upstream qwen2.5:72b distribution). That license grants use for non-commercial purposes only; commercial use requires a separate license from Alibaba Cloud. Earlier versions of this page stated MIT and marketed commercial deployment; both were incorrect, and the MIT statement has been removed. THOX’s packaging material does not change the weights’ license, and no statement on any THOX page grants commercial rights in them.

MagStack and MeshStack technology is proprietary to Thox.ai LLC. Publication of this model does not license THOX mesh technology, patents, or trademarks beyond identifying the model.

Provenance

THOX MeshStack Cluster family. First listed on Ollama under Thox-ai in 2025 and held private; publicly released 2026-10-31 by order of Tommy Xaypanya, CTO and Co-Founder of THOX.ai, as part of the MeshStack model family release. Upstream: Qwen/Qwen2.5-72B-Instruct, Ollama tag qwen2.5:72b; the weight layer is byte-identical to the upstream provider’s Ollama weight layer (SHA-256 verified in the 2026-10-31 release review) and identical to thox-cluster-secure’s weight layer. Model card: https://huggingface.co/Thox-ai/thox-cluster-scout. Correction history: inherited catalog claims (cost-saving, productivity and concurrency figures) removed and the license corrected from MIT to the Qwen Research License with the commercial marketing withdrawn, as recorded in the correction notice above. Enterprise: enterprise@thox.ai.