2  Downloads Updated  2 days ago

Fixes the issue with Open WebUI not passing tools (native) and system prompt information properly. It requires bigger value for num_ctx default: 32768. Tested with Open WebUI v0.9.6 and v0.10.2. Just built on top of official qat of gemma4-26b