antony66/
gemma3-tools:27b

213 5 months ago

Enhanced function (tool) calling capabilities with modified template as supposed by Philipp Schmid (Google DeepMind) for gemma3 models.

vision tools 27b

5 months ago

fc74df1b2053 · 17GB

model
gemma3
·
27.4B
·
Q4_K_M
template
{{- if .Messages }} {{- if or .System .Tools }}<start_of_turn>user {{- if .System}} {{ .System }} {{
license
Gemma Terms of Use Last modified: February 21, 2024 By using, reproducing, modifying, distributing,
params
{ "stop": [ "<end_of_turn>" ], "temperature": 1, "top_k": 64, "top_p": 0
license
Gemma Terms of Use Last modified: February 21, 2024 By using, reproducing, modifying, distributing,

Readme

After I had been struggling a lot with different tool calling enabled variations of gemma3, I found that literally every of them hallucinate more or less often when calling tools. Meanwhile, Google officially confirmed the function calling capability of gemma3 in their release notes. Something was clearly wrong and dots didn’t connect.

I dug deeper and found this article from Philipp Schmid (Google DeepMind) showcasing the function calling with gemma3. So, I’ve created a new template for this model and tested it through a few llamaindex based agents that I have at my disposal. No hallucinations at all.