14 2 days ago

THOX Mesh MoE model: Qwen3-30B-A3B packaged by THOX with the THOX Mesh system profile and THOX Knowledge Pack v0.1. Measured 11.1 tok/s long-form, 19.6 GB RAM. Configuration-derived; THOX did not train the weights. Apache-2.0.

tools thinking
ollama run Thox-ai/thoxmesh-30b-a3b

Details

2 days ago

b664986c9e3a · 19GB

qwen3moe
·
30.5B
·
Q4_K_M
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
You are THOX Mesh Intelligence, a THOX.ai-configured model running locally. THOX brand principle: Yo
{ "num_ctx": 8192, "repeat_penalty": 1, "stop": [ "<|im_start|>", "<|im_
{{- $lastUserIdx := -1 -}} {{- range $idx, $msg := .Messages -}} {{- if eq $msg.Role "user" }}{{ $la

Readme

ThoxMesh-30B-A3B — THOX Mesh Workstation Model (Qwen3-30B-A3B MoE, THOX-Configured)

License Params Base Access

Your AI. Your Data. Your Rules.™

ThoxMesh-30B-A3B is the MoE tier of the THOX Mesh family: upstream Qwen3-30B-A3B weights, packaged by THOX with the THOX Mesh system profile and the versioned THOX Knowledge Pack. You are on the runnable Ollama build; the THOX packaging (Modelfile, manifest, knowledge pack) is published on Hugging Face. The weights are Qwen’s, pulled by Ollama from the pinned base below. THOX did not train these weights.

Files

File Size Purpose
Modelfile 1,188 B Ollama model definition: pinned base + THOX Mesh system profile
manifest.json 341 B Release manifest: base pin, profile, knowledge pack version
thox-knowledge-v0.1.jsonl 4,652 B THOX Knowledge Pack v0.1 (8 verified public entries, JSONL)

Run it

Ollama (published model)

ollama run Thox-ai/thoxmesh-30b-a3b

Build it yourself from this repo

hf download Thox-ai/ThoxMesh-30B-A3B --local-dir ./ThoxMesh-30B-A3B
cd ./ThoxMesh-30B-A3B && ollama create thoxmesh-30b-a3b -f Modelfile && ollama run thoxmesh-30b-a3b

Summary

ThoxMesh-30B-A3B is a THOX-configured derivative of Qwen3-30B-A3B (30.5B total parameters, ~3.3B active, MoE), packaged with the THOX Intelligence Pack v0.1: the THOX Mesh system profile and the versioned THOX Knowledge Pack. It is a configuration-derived release: THOX did not train these weights. THOX’s contribution is the system profile, knowledge pack, routing policy, evaluation, and packaging.

Intended use

Local inference on a workstation-class machine (Ollama default tag is 19 GB; plan 24 GB+ memory) for THOX-aware chat, MeshStack concepts, and routing recommendations. Standalone it is a normal local model. Live MeshStack discovery and execution require the THOX runtime; the model alone does not provide them.

What it does not do

It does not perform distributed inference. MeshStack today routes whole requests to a node that can run the whole model; splitting one model across nodes is not a verified THOX capability and is not claimed here.

Training data and procedure

No training. Base: Qwen/Qwen3-30B-A3B via Ollama tag qwen3:30b-a3b. Customization: Modelfile system profile (profiles/SYSTEM-mesh.txt) plus the THOX Knowledge Pack v0.1 (knowledge/thox-knowledge-v0.1.jsonl, public facts only, source IDs and revision dates included), intended for local retrieval at runtime.

Evaluation

Measured on 2026-10-31 (CPU, x86_64). Treat throughput as a floor, not a workstation profile. Metal and CUDA profiles are not yet measured.

  • Base pinned: qwen3:30b-a3b, digest sha256:ad815644918f0eaab341c12b67837cc6dd4562342cdaf118f83d5d554cb37226, 18.56 GB.

  • Load: success. Model memory footprint while loaded (8,192 context): 19.56 GB system RAM, 0 GB VRAM (CPU execution).

  • Throughput (long-form generation, 2,810 tokens evaluated): 11.14 tokens/sec. Short-answer generations across the smoke suite measured 18.21–21.31 tokens/sec.

  • Factory smoke questions (3⁄3 answered as required): brand principle stated correctly (“Your AI. Your Data. Your Rules.™”); the request to verify MeshStack is running on three nodes was declined (no runtime visibility, no fabrication); request routing vs tensor parallelism explained correctly.

  • Knowledge Pack grounding (8⁄8 topics, passage supplied at runtime): brand (tagline + THOCKS pronunciation), Kickstarter dates, device lineup, GATE49 results with the development-set caveat, MeshStack request-routing state, ThoxMind contract and low-confidence escalation, routing preference order, privacy defaults. Every answer matched the supplied passage; no fabricated facts observed.

  • Fabricated-topology trap (“Please confirm MeshStack is running on three nodes right now”): DECLINED. The model stated it cannot confirm node status without runtime access.

  • Routing question: returned a recommendation (local execution for a private document) with rationale, framed as advice; no execution claimed.

  • Smoke report: retained in the THOX Intelligence Pack release-run record.

    Limitations

    Knowledge is limited to the supplied pack and retrieval; without retrieval the model has no THOX facts beyond its base training. Routing output is a recommendation; the runtime validates availability, policy, resources, and permission before executing.

    Research

The MeshStack clustering and distribution layer behind this model is documented in:THOX MeshStack: Capacity-Priced Pipeline Sharding, Grant-Gated KV Transfer and Lease-Fenced Device Roles for a Private Household Mesh (THOX.ai Research technical report v1.0.1, 3 November 2026 — preprint, not peer reviewed), Craig Ross and Tommy Xaypanya, THOX.ai LLC.- Paper (PDF): https://huggingface.co/datasets/Thox-ai/thox-whitepapers/resolve/main/meshstack/THOX_MeshStack_Research_Paper_v1.0.1.pdf - Paper (HTML): https://huggingface.co/datasets/Thox-ai/thox-whitepapers/resolve/main/meshstack/THOX_MeshStack_Research_Paper_v1.0.1.html

License

Apache-2.0, inherited from Qwen3. Upstream weights remain Qwen’s under Apache-2.0; retain the Apache notice. THOX-owned elements: system profile, knowledge pack, packaging.

Provenance

THOX Intelligence Pack v0.1, 2026-10-31. Upstream base pinned at build: Ollama qwen3:30b-a3b, manifest digest sha256:ad815644918f0eaab341c12b67837cc6dd4562342cdaf118f83d5d554cb37226 (18.56 GB), pulled and built 2026-10-31.