rubinmaximilian/ Monk-Router-phi4mini:latest

42 1 month ago

A high-precision, hardware-aware router built on Phi-4 Mini (3.8B). It acts as a dispatcher for local AI setups, automatically deciding whether a prompt should run on edge hardware (like a Jetson Nano), a local GPU, or the cloud based on task complexity.

tools
... /
messages
1ce409908333 · 350B
[{"role":"user","content":"This python code is too complex for the edge device, spin up the review team on the main GPU."},{"role":"assistant","content":"{\\\"logic\\\": \\\"Task complexity high. Offloading to GPU.\\\", \\\"tool_call\\\": {\\\"name\\\": \\\"activate_swarm\\\", \\\"parameters\\\": {\\\"combo_name\\\": \\\"code_review_team\\\"}}}"}]