128 1 month ago

A lightweight, hardware-aware router built on Gemma 4 E2B. It acts as a dispatcher for local AI setups, automatically deciding whether a prompt should run on edge hardware (like a Jetson Nano), a local GPU, or the cloud based on task complexity.

vision tools thinking audio
82246b8270cf · 113B
{
"num_ctx": 2048,
"stop": [
"<|turn|>",
"<end_of_turn>"
],
"temperature": 0,
"top_k": 64,
"top_p": 0.95
}