mirage335/ Nemotron-3-Nano-30B-A3B-virtuoso:latest

266 1 month ago

Possibly useful for agentic AI systems. Apparently compatible with ~16GB VRAM .

tools
... /
params
07f7663c37f1 · 116B
{
"num_ctx": 49152,
"num_gpu": 999,
"num_keep": 49152,
"num_predict": 65536,
"num_thread": 14,
"temperature": 0.8,
"top_p": 0.95
}