213 5 months ago

Enhanced function (tool) calling capabilities with modified template as supposed by Philipp Schmid (Google DeepMind) for gemma3 models.

vision tools 27b

Models

View all →

Readme

After I had been struggling a lot with different tool calling enabled variations of gemma3, I found that literally every of them hallucinate more or less often when calling tools. Meanwhile, Google officially confirmed the function calling capability of gemma3 in their release notes. Something was clearly wrong and dots didn’t connect.

I dug deeper and found this article from Philipp Schmid (Google DeepMind) showcasing the function calling with gemma3. So, I’ve created a new template for this model and tested it through a few llamaindex based agents that I have at my disposal. No hallucinations at all.