Tülu 3 with tool call support

tools 8b 70b

ollama run cow/tulu3_tools:8b

curl http://localhost:11434/api/chat \
  -d '{
    "model": "cow/tulu3_tools:8b",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='cow/tulu3_tools:8b',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'cow/tulu3_tools:8b',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 year ago

1 year ago

9c0125fb3727 · 4.9GB ·

model

archllama

parameters8.03B

quantizationQ4_K_M

4.9GB

system

You are Tulu 3, a helpful and harmless AI Assistant built by the Allen Institute for AI.

88B

license

LLAMA 3.1 COMMUNITY LICENSE AGREEMENT Llama 3.1 Version Release Date: July 23, 2024 “Agreement”

7.6kB

template

{{- if or .System .Tools }}<|system|> {{- if .System }} {{ .System }} {{- end }} {{- if .Tools }} Wh

1.9kB

Readme

cow/tulu3_tools

Template modified from cow/gemma2_tools. This model only modifies template files to support tools.

Known issues

Tülu 3 sometimes calls unnecessarily tool calls. If you encounter this problem, ignore it because the model will respond normally after calling the tools.