AgentBDW/ GIR9b:latest

66 1 month ago

CTA agent for Claude Code / OpenCode / Hermes with the only command of follow instructions. Tested with 16GB of VRAM with a Context of 64k to avoid OOM with a 680M AMD iGPU =O) Results of 40~45 TPS using redis to queue requests. QWEN:9B What's next...!!!!

tools
... /
params
a656337addd7 · 120B
{
"num_ctx": 65536,
"num_keep": 15536,
"presence_penalty": 1.5,
"repeat_penalty": 1.2,
"temperature": 0.2,
"top_k": 20,
"top_p": 0.9
}