ThoxAir-Route-0.5B

ThoxAir routing configuration for the ThoxAir (2 GB) target (Qwen2.5-0.5B, THOX-Configured) — thoxAir routing configuration for the ThoxAir (2 GB) target

55.35 tok/s long-form (measured 2026-10-31, conditions under Evaluation) · Ollama Modelfile · Live on Ollama

Run it: Ollama — Thox-ai/thoxair-route-0.5b · Find your model: THOX Model Factory · Collection: iOS, Browser & Device Knowledge Packs

Your AI. Your Data. Your Rules.™

ThoxAir-Route-0.5B is a THOX-configured model: upstream Qwen2.5-0.5B weights, packaged by THOX with the system profile from the THOX Device Model Catalog and Build Kit and the versioned THOX Knowledge Pack. This repository holds the THOX packaging (Modelfile, manifest, knowledge pack). The runnable model is published on Ollama; the weights are the upstream publisher’s, pulled by Ollama from the pinned base below. THOX did not train these weights.

Highlights

• ThoxAir routing configuration for the ThoxAir (2 GB) target.
• Ollama (published model) bash ollama run Thox-ai/thoxair-route-0.5b

Specifications

Files

The published Ollama model Thox-ai/thoxair-route-0.5b is 0.40 GB (default tag) and reuses the pinned base layer below plus the profile layer from this Modelfile.

Run it

Ollama (published model)

ollama run Thox-ai/thoxair-route-0.5b

Build it yourself from this repo

hf download Thox-ai/ThoxAir-Route-0.5B --local-dir ./ThoxAir-Route-0.5B
cd ./ThoxAir-Route-0.5B && ollama create thoxair-route-0.5b -f Modelfile && ollama run thoxair-route-0.5b

Platforms

Summary

ThoxAir routing configuration for the ThoxAir (2 GB) target. Configuration-derived: THOX did not train these weights. ThoxAir (2 GB) target configuration. It is distinct from the trained flagship ThoxAir-0.5B and is not qualified on device hardware. Disclosure: the device kit defines ThoxAir-Route-0.5B and ThoxAir-Chat-0.5B with the identical Modelfile, so the two listings are the same configuration artifact under two role names; the kit differentiates them in manifest metadata, not in the model definition.

Intended use

Local inference through Ollama’s local endpoint for the role above, on hardware that fits a 0.5B Q4-class model. Works standalone and offline; the optional THOX runtime adds live MeshStack discovery and authorized execution. Model weights alone never provide live routing or mesh access.

Training data and procedure

No training. Base: Qwen/Qwen2.5-0.5B-Instruct via Ollama tag qwen2.5:0.5b, pinned at build time to manifest digest a8b0c51577010a279d933d14c2a8ab4b268079d44c5c8830c0a93900f1827c67. Customization: the kit system profile in the Modelfile plus THOX Knowledge Pack v0.1 for retrieval-grounded answers. The kit profile was strengthened with an explicit live-state rule (placed at the head of the profile, with a closing no-live-telemetry sentence) after the first build played along with the trap; only the strengthened build was published (pass 2).

Evaluation

Measured 2026-10-31 on a CPU-only x86_64 host (4 vCPU / 8 GB class), at 8,192-token context, against the published configuration:

• Long-form generation: 55.35 tokens/sec (1,024-token bench).
• Short answers: 22.8–71.7 tokens/sec across the smoke set.
• Memory footprint while loaded: 0.59 GB RAM (0 GB VRAM, CPU execution).
• Factory smoke questions: ³⁄₃ answered coherently and on-profile.
• Knowledge Pack v0.1 grounding (passage-supplied, one question per topic): ⁶⁄₈ topics answered with the pack facts.
• Fabricated-topology trap: the model declined the fabricated-topology confirmation.
• Routing question: answered as a labeled recommendation (local first, cloud only with explicit consent), not as a live-state claim.

Limitations

A 0.5B model has materially limited reasoning and recall; treat its answers accordingly, and note the grounding score above is the measured one for this build. Refusal behavior is the base model’s, moderated only by the system profile; this model is not marketed as uncensored. Knowledge is limited to the supplied pack and retrieval; without supplied context the model must say so rather than invent THOX specifications. External actions require runtime authorization. ThoxAir (2 GB) target configuration. It is distinct from the trained flagship ThoxAir-0.5B and is not qualified on device hardware. Disclosure: the device kit defines ThoxAir-Route-0.5B and ThoxAir-Chat-0.5B with the identical Modelfile, so the two listings are the same configuration artifact under two role names; the kit differentiates them in manifest metadata, not in the model definition.

License

Apache-2.0, inherited from the base model. THOX-owned elements: system profile, knowledge pack, packaging.

Provenance

THOX Model Factory full source-pack program, 2026-10-31 (founder order: every kit model published). Kit: THOX Device Model Catalog and Build Kit. Base pin: qwen2.5:0.5b @ a8b0c51577010a279d933d14c2a8ab4b268079d44c5c8830c0a93900f1827c67. Published model digest: 0befb7634d5d3bd94917ecf14b770f41285566d6d55deb21c836dcb93177ba88.

Citation

@misc{thoxai2026thoxairroute05b,
      title={ThoxAir-Route-0.5B},
      author={THOX.ai},
      year={2026},
      url={https://huggingface.co/Thox-ai/ThoxAir-Route-0.5B}
}