imranzunzani/ gemma4-26bitqat-owui-fix:latest

2 2 days ago

Fixes the issue with Open WebUI not passing tools (native) and system prompt information properly. It requires bigger value for num_ctx default: 32768. Tested with Open WebUI v0.9.6 and v0.10.2. Just built on top of official qat of gemma4-26b

vision tools thinking
... /
params
a5a1799ecd52 · 145B
{
"num_ctx": 32768,
"stop": [
"<end_of_turn>",
"<end_call>",
"<end_response>"
],
"temperature": 0.3,
"top_k": 64,
"top_p": 0.95
}