Tülu 3 with tool call support

tools 8b 70b

ollama run cow/tulu3_tools:70b

curl http://localhost:11434/api/chat \
  -d '{
    "model": "cow/tulu3_tools:70b",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='cow/tulu3_tools:70b',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'cow/tulu3_tools:70b',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 year ago

1 year ago

a9e9fc636f9b · 43GB ·

model

archllama

parameters70.6B

quantizationQ4_K_M

43GB

system

You are Tulu 3, a helpful and harmless AI Assistant built by the Allen Institute for AI.

88B

license

LLAMA 3.1 COMMUNITY LICENSE AGREEMENT Llama 3.1 Version Release Date: July 23, 2024 “Agreement”

7.6kB

template

{{- if or .System .Tools }}<|system|> {{- if .System }} {{ .System }} {{- end }} {{- if .Tools }} Wh

1.8kB

Readme

cow/tulu3_tools

Template modified from cow/gemma2_tools. This model only modifies template files to support tools.

Known issues

Tülu 3 sometimes calls unnecessarily tool calls. If you encounter this problem, ignore it because the model will respond normally after calling the tools.