2 2 days ago

Fixes the issue with Open WebUI not passing tools (native) and system prompt information properly. It requires bigger value for num_ctx default: 32768. Tested with Open WebUI v0.9.6 and v0.10.2. Just built on top of official qat of gemma4-26b

vision tools thinking
ollama run imranzunzani/gemma4-26bitqat-owui-fix

Details

2 days ago

45ba23c5cf28 · 16GB ·

gemma4
·
25.2B
·
Q4_0
clip
·
573M
·
BF16
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
{ "num_ctx": 32768, "stop": [ "<end_of_turn>", "<end_call>", "<end_r
{{- if .System }}<start_of_turn>developer {{ .System }} {{- if .Tools }} You have access to the foll

Readme

No readme