imranzunzani/ gemma4-26bitqat-owui-fix:latest

2 2 days ago

Fixes the issue with Open WebUI not passing tools (native) and system prompt information properly. It requires bigger value for num_ctx default: 32768. Tested with Open WebUI v0.9.6 and v0.10.2. Just built on top of official qat of gemma4-26b

vision tools thinking
... /
template
9b38e26e36e8 · 879B
{{- if .System }}<start_of_turn>developer
{{ .System }}
{{- if .Tools }}
You have access to the following tools:
{{- range .Tools }}
<start_function_declaration>declaration:{{ .Function.Name }}{description:<escape>{{ .Function.Description }}<escape>,parameters:{{ .Function.Parameters }}}<end_function_declaration>
{{- end }}
{{- end }}<end_of_turn>
{{- end }}
{{- range .Messages }}
{{- if eq .Role "user" }}<start_of_turn>user
{{ .Content }}<end_of_turn>
{{- else if eq .Role "assistant" }}<start_of_turn>model
{{- if .Content }}{{ .Content }}{{- end }}
{{- if .ToolCalls }}
{{- range .ToolCalls }}<start_call>call:{{ .Function.Name }}{arguments:{{ .Function.Arguments }}}<end_call>
{{- end }}
{{- end }}<end_of_turn>
{{- else if eq .Role "tool" }}<start_of_turn>tool
<start_response>response:{{ .Content }}<end_response><end_of_turn>
{{- end }}
{{- end }}<start_of_turn>model