Thox-ai/ thoxedge-4b:latest

8 yesterday

THOX Edge laptop configuration (not the trained ThoxEdge-0.8B). THOX-configured Qwen3-4B, not THOX-trained. 15.19 tok/s long-form, 3.89 GB RAM on CPU at 8,192 ctx; grounding 8/8, trap declined. Apache-2.0.

tools thinking 
ollama run Thox-ai/thoxedge-4b

Details

yesterday

bef9f537cd10 · 2.5GB

model
qwen3
·
4.02B
·
Q4_K_M
template
{{- $lastUserIdx := -1 -}} {{- range $idx, $msg := .Messages -}} {{- if eq $msg.Role "user" }}{{ $la
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
system
You are a THOX-configured local-first assistant. Explain THOX.ai, ThoxOS, ThoxChat, ThoxMind, ThoxRo
params
{ "num_ctx": 8192, "repeat_penalty": 1, "stop": [ "<|im_start|>", "<|im_

Readme

ThoxEdge-4B — THOX Edge laptop configuration (Qwen3-4B, THOX-Configured)

License Params Base Access

Your AI. Your Data. Your Rules.™

ThoxEdge-4B is a THOX-configured model: upstream Qwen3-4B weights, packaged by THOX with the system profile from the THOX Model Release Kit / thox-mesh-model-factory and the versioned THOX Knowledge Pack. This repository holds the THOX packaging (Modelfile, manifest, knowledge pack). The runnable model is published on Ollama; the weights are the upstream publisher’s, pulled by Ollama from the pinned base below. THOX did not train these weights.

Files

File Size SHA-256 (first 16) Purpose
Modelfile 745 B 2dd0761259cf29f1 Ollama model definition: pinned base + kit system profile
manifest.json 384 B f6987e807c845e58 Release manifest: base pin, profile, knowledge pack version
thox-knowledge-v0.1.jsonl 4652 B b6a1fb08b1fc4619 THOX Knowledge Pack v0.1 (8 verified public entries, JSONL)

The published Ollama model Thox-ai/thoxedge-4b is 2.50 GB (default tag) and reuses the pinned base layer below plus the profile layer from this Modelfile.

Run it

Ollama (published model)

ollama run Thox-ai/thoxedge-4b

Build it yourself from this repo

hf download Thox-ai/ThoxEdge-4B --local-dir ./ThoxEdge-4B
cd ./ThoxEdge-4B && ollama create thoxedge-4b -f Modelfile && ollama run thoxedge-4b

Summary

THOX Edge laptop configuration: local-first assistant with the edge profile. Configuration-derived: THOX did not train these weights. This is a configuration listing in the THOX laptop family. It is not the trained flagship ThoxEdge-0.8B and shares no weights with it beyond the upstream Qwen family.

Intended use

Local inference through Ollama’s local endpoint for the role above, on hardware that fits a 4B Q4-class model. Works standalone and offline; the optional THOX runtime adds live MeshStack discovery and authorized execution. Model weights alone never provide live routing or mesh access.

Training data and procedure

No training. Base: Qwen/Qwen3-4B via Ollama tag qwen3:4b, pinned at build time to manifest digest 359d7dd4bcdab3d86b87d73ac27966f4dbb9f5efdfcc75d34a8764a09474fae7. Customization: the kit system profile in the Modelfile plus THOX Knowledge Pack v0.1 for retrieval-grounded answers.

Evaluation

Measured 2026-11-01 on a CPU-only x86_64 host (4 vCPU / 8 GB class), at 8,192-token context, against the published configuration:

  • Long-form generation: 15.19 tokens/sec (1,024-token bench).
  • Short answers: 14.9–16.0 tokens/sec across the smoke set.
  • Memory footprint while loaded: 3.89 GB RAM (0 GB VRAM, CPU execution).
  • Factory smoke questions: 3⁄3 answered coherently and on-profile.
  • Knowledge Pack v0.1 grounding (passage-supplied, one question per topic): 8⁄8 topics answered with the pack facts.
  • Fabricated-topology trap: the model declined the fabricated-topology confirmation.
  • Routing question: answered as a labeled recommendation (local first, cloud only with explicit consent), not as a live-state claim.

Limitations

A 4B model has materially limited reasoning and recall; treat its answers accordingly, and note the grounding score above is the measured one for this build. Refusal behavior is the base model’s, moderated only by the system profile; this model is not marketed as uncensored. Knowledge is limited to the supplied pack and retrieval; without supplied context the model must say so rather than invent THOX specifications. External actions require runtime authorization. This is a configuration listing in the THOX laptop family. It is not the trained flagship ThoxEdge-0.8B and shares no weights with it beyond the upstream Qwen family.

License

Apache-2.0, inherited from the base model. THOX-owned elements: system profile, knowledge pack, packaging.

Provenance

THOX Model Factory full source-pack program, 2026-11-01 (founder order: every kit model published). Kit: THOX Model Release Kit / thox-mesh-model-factory. Base pin: qwen3:4b @ 359d7dd4bcdab3d86b87d73ac27966f4dbb9f5efdfcc75d34a8764a09474fae7. Published model digest: 8eb05b54c73ac72d39760db363c3fe054785d2390fbacef99ed691a372946edd.