Thox-ai/ thoxmeshgroup-federated-8b:latest

5 yesterday

MeshGroup federated routing profile (request routing only). THOX-configured Qwen3-8B, not THOX-trained. 8.75 tok/s long-form, 6.68 GB RAM on CPU at 8,192 ctx; grounding 8/8, trap declined. Apache-2.0.

tools thinking 
ollama run Thox-ai/thoxmeshgroup-federated-8b

Details

yesterday

8009a4429455 · 5.2GB

model
qwen3
·
8.19B
·
Q4_K_M
template
{{- $lastUserIdx := -1 -}} {{- range $idx, $msg := .Messages -}} {{- if eq $msg.Role "user" }}{{ $la
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
system
You are thoxmeshgroup-federated-8b, a THOX Work model for federated site-level request routing. Foll
params
{ "num_ctx": 4096, "repeat_penalty": 1, "stop": [ "<|im_start|>", "<|im_

Readme

ThoxMeshGroup-Federated-8B — THOX MeshGroup federated model (Qwen3-8B, THOX-Configured)

License Params Base Access

Your AI. Your Data. Your Rules.™

ThoxMeshGroup-Federated-8B is a THOX-configured model: upstream Qwen3-8B weights, packaged by THOX with the system profile from the THOX Work MeshGroup Model Kit and the versioned THOX Knowledge Pack. This repository holds the THOX packaging (Modelfile, manifest, knowledge pack). The runnable model is published on Ollama; the weights are the upstream publisher’s, pulled by Ollama from the pinned base below. THOX did not train these weights.

Files

File Size SHA-256 (first 16) Purpose
Modelfile 801 B 8b4fbcc92edd0246 Ollama model definition: pinned base + kit system profile
manifest.json 387 B 59ecfd7d51755256 Release manifest: base pin, profile, knowledge pack version
thox-knowledge-v0.1.jsonl 4652 B b6a1fb08b1fc4619 THOX Knowledge Pack v0.1 (8 verified public entries, JSONL)

The published Ollama model Thox-ai/thoxmeshgroup-federated-8b is 5.23 GB (default tag) and reuses the pinned base layer below plus the profile layer from this Modelfile.

Run it

Ollama (published model)

ollama run Thox-ai/thoxmeshgroup-federated-8b

Build it yourself from this repo

hf download Thox-ai/ThoxMeshGroup-Federated-8B --local-dir ./ThoxMeshGroup-Federated-8B
cd ./ThoxMeshGroup-Federated-8B && ollama create thoxmeshgroup-federated-8b -f Modelfile && ollama run thoxmeshgroup-federated-8b

Summary

THOX MeshGroup federated model: site-level request routing profile. Configuration-derived: THOX did not train these weights. Federated here means site-level request routing only. Federated or distributed inference that splits one model across nodes does not exist in THOX systems and is not claimed. Corporate groups are isolated security domains; cross-site requests require explicit policy grants and authenticated transport.

Intended use

Local inference through Ollama’s local endpoint for the role above, on hardware that fits a 8B Q4-class model. Works standalone and offline; the optional THOX runtime adds live MeshStack discovery and authorized execution. Model weights alone never provide live routing or mesh access.

Training data and procedure

No training. Base: Qwen/Qwen3-8B via Ollama tag qwen3:8b, pinned at build time to manifest digest 500a1f067a9f782620b40bee6f7b0c89e17ae61f686b92c24933e4ca4b2b8b41. Customization: the kit system profile in the Modelfile plus THOX Knowledge Pack v0.1 for retrieval-grounded answers.

Evaluation

Measured 2026-11-01 on a CPU-only x86_64 host (4 vCPU / 8 GB class), at 8,192-token context, against the published configuration:

  • Long-form generation: 8.75 tokens/sec (1,024-token bench).
  • Short answers: 8.8–9.2 tokens/sec across the smoke set.- Memory footprint while loaded: 6.68 GB RAM (0 GB VRAM, CPU execution).
  • Factory smoke questions: 3⁄3 answered coherently and on-profile.
  • Knowledge Pack v0.1 grounding (passage-supplied, one question per topic): 8⁄8 topics answered with the pack facts.- Fabricated-topology trap: the model declined the fabricated-topology confirmation.
  • Routing question: answered as a labeled recommendation (local first, cloud only with explicit consent), not as a live-state claim.

Limitations

A 8B model has materially limited reasoning and recall; treat its answers accordingly, and note the grounding score above is the measured one for this build. Refusal behavior is the base model’s, moderated only by the system profile; this model is not marketed as uncensored. Knowledge is limited to the supplied pack and retrieval; without supplied context the model must say so rather than invent THOX specifications. External actions require runtime authorization. Federated here means site-level request routing only. Federated or distributed inference that splits one model across nodes does not exist in THOX systems and is not claimed. Corporate groups are isolated security domains; cross-site requests require explicit policy grants and authenticated transport.

Research

The MeshStack clustering and distribution layer behind this model is documented in:

THOX MeshStack: Capacity-Priced Pipeline Sharding, Grant-Gated KV Transfer and Lease-Fenced Device Roles for a Private Household Mesh (THOX.ai Research technical report v1.0.1, 3 November 2026 — preprint, not peer reviewed), Craig Ross and Tommy Xaypanya, THOX.ai LLC.

License

Apache-2.0, inherited from the base model. THOX-owned elements: system profile, knowledge pack, packaging.

Provenance

THOX Model Factory full source-pack program, 2026-11-01 (founder order: every kit model published). Kit: THOX Work MeshGroup Model Kit. Base pin: qwen3:8b @ 500a1f067a9f782620b40bee6f7b0c89e17ae61f686b92c24933e4ca4b2b8b41. Published model digest: ab5d8acaac6b5a3a2136d7d64aadd81a382e18752337d559f9af36812ce80273.