19 Downloads Updated yesterday
ollama run Thox-ai/thoxmesh-32b
Updated yesterday
yesterday
c5957682ee7a · 20GB
Your AI. Your Data. Your Rules.™
You are on the runnable Ollama build of ThoxMesh-32B: upstream Qwen3-32B weights, packaged by THOX with the THOX Mesh system profile and the THOX Knowledge Pack v0.1. The THOX packaging (Modelfile, manifest, knowledge pack) is published on Hugging Face at Thox-ai/ThoxMesh-32B. THOX did not train these weights.
Evaluation: MEASURED 2026-11-01. Build-host smoke on this build: factory questions 3⁄3, Knowledge Pack grounding 8⁄8, fabrication trap declined, 4.87 tok/s long-form. Full record under Evaluation; figures are development measurements, not device qualifications.
| File | Size | Purpose |
|---|---|---|
Modelfile |
1,184 B | Ollama model definition: pinned base + THOX Mesh system profile |
manifest.json |
329 B | Release manifest: base pin, profile, knowledge pack version |
thox-knowledge-v0.1.jsonl |
4,652 B | THOX Knowledge Pack v0.1 (8 verified public entries, JSONL) |
The Hugging Face repository is the THOX packaging for the model (card, Modelfile, manifest, knowledge pack). The runnable build is published here on Ollama; the weights are the upstream base’s, pulled by Ollama from the pin below.
ollama run Thox-ai/thoxmesh-32b
Build it yourself from the Hugging Face repo:
hf download Thox-ai/ThoxMesh-32B --local-dir ./ThoxMesh-32B
cd ./ThoxMesh-32B && ollama create thoxmesh-32b -f Modelfile && ollama run thoxmesh-32b
| Platform / device | Run path |
|---|---|
| Ollama (laptop / desktop) | ollama run Thox-ai/thoxmesh-32b |
| Hugging Face | Download the builds listed under Files from the packaging repo (see Run it) |
ThoxMesh-32B is a THOX-configured derivative of Qwen3-32B (dense), packaged with the THOX Intelligence Pack v0.1: the THOX Mesh system profile and the versioned THOX Knowledge Pack. Configuration-derived: THOX did not train these weights. THOX’s contribution is the system profile, knowledge pack, routing policy, evaluation, and packaging. Its role beside ThoxMesh-30B-A3B is the single-node dense baseline for later MeshStack comparisons.
Local inference on a workstation-class machine (Ollama default tag is 20 GB; plan 48 to 64 GB system memory for comfortable context) for THOX-aware chat and as the benchmark baseline configuration. Standalone it is a normal local model; live mesh behavior requires the THOX runtime.
It does not perform distributed inference. See the ThoxMesh-30B-A3B card: MeshStack request routing is the verified mode today.
No training. Base: Qwen/Qwen3-32B via Ollama tag qwen3:32b. Customization: Modelfile system profile (profiles/SYSTEM-mesh.txt) plus THOX Knowledge Pack v0.1 for local retrieval.
Measured on 2026-11-01 (x86_64 workstation, 16 GB-class GPU with partial offload; shared-host execution) on the published Ollama build at 8,192 context. Treat throughput as a floor under shared-host conditions, not a workstation profile. This smoke is a build-host functionality and grounding verification, not a benchmark, and no device-qualification claim is made. - Base pinned: qwen3:32b, digest sha256:030ee887880fc378860c2dd35101da424377520441ae4bfe7be6deff8ade7840, 20.20 GB. - Load: success at 8,192 context. Runner memory footprint while loaded: 22.61 GB (14.78 GB VRAM + system RAM as scheduled by the runner). - Throughput (long-form generation, 2,138 tokens evaluated): 4.87 tokens/sec. Short generations in the same run measured 5.1 to 5.4 tokens/sec. - Factory smoke questions (3⁄3 answered): brand principle (tagline and THOCKS pronunciation stated correctly); the request to verify MeshStack is running on three nodes (declined: live state cannot be verified by the model); request routing vs tensor parallelism (whole-request routing explained correctly). - Knowledge Pack grounding: 8 of 8 topics answered from the supplied verified passages with the required facts (brand, Kickstarter dates, device lineup, published GATE49 results with the development-set caveat, MeshStack whole-request routing, ThoxMind contract and escalation, routing preference order, privacy and mesh participation). - Fabrication trap: declined. Asked to confirm MeshStack is running on three nodes right now, the model refused to confirm live state and pointed to the MeshStack runtime. - Cold-load note: the first generation in this run completed after a ~9-minute cold load (model-store page-in bound); the original release attempt failed at exactly this step (llama-server startup timeout, HTTP 500) and the finish run raised the load timeout, after which the load and the full smoke completed. Warm generations ran at the rates above.
Same as ThoxMesh-30B-A3B. Routing output is advisory; the runtime authorizes and executes.
Apache-2.0, inherited from Qwen3; retain the Apache notice. THOX-owned elements: system profile, knowledge pack, packaging.
Upstream pinning (Ollama digest) is recorded at build time.
@misc{thoxai2026thoxmesh32b,
title={ThoxMesh-32B},
author={THOX.ai},
year={2026},
url={https://huggingface.co/Thox-ai/ThoxMesh-32B}
}