Tools 8B

58 Pulls Updated 9 days ago

10 days ago

dcfba2066ee4 · 6.6GB

model
llama
·
8.03B
·
Q6_K
params
{"num_ctx":131072,"stop":["<|start_header_id|>","<|end_header_id|>","<|eot_id|>"]}
template
{{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{- if .System }} {{ .System }} {{- end }} {{- if .Tools }} You are a helpful assistant with tool calling capabilities. When you receive a tool call response, use the output to format an answer to the orginal use question. {{- end }} {{- end }}<|eot_id|> {{- range $i, $_ := .Messages }} {{- $last := eq (len (slice $.Messages $i)) 1 }} {{- if eq .Role "user" }}<|start_header_id|>user<|end_header_id|> {{- if and $.Tools $last }} Given the following functions, please respond with a JSON for a function call with its proper arguments that best answers the given prompt. Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}. Do not use variables. {{ $.Tools }} {{- end }} {{ .Content }}<|eot_id|>{{ if $last }}<|start_header_id|>assistant<|end_header_id|> {{ end }} {{- else if eq .Role "assistant" }}<|start_header_id|>assistant<|end_header_id|> {{- if .ToolCalls }} {{- range .ToolCalls }}{"name": "{{ .Function.Name }}", "parameters": {{ .Function.Arguments }}}{{ end }} {{- else }} {{ .Content }}{{ if not $last }}<|eot_id|>{{ end }} {{- end }} {{- else if eq .Role "tool" }}<|start_header_id|>ipython<|end_header_id|> {{ .Content }}<|eot_id|>{{ if $last }}<|start_header_id|>assistant<|end_header_id|> {{ end }} {{- end }} {{- end }}

Readme

Forge: A Meta Llama 3.1 Based Model

Overview

This model, Forge, is a powerful language model based on the well-established Meta Llama 3.1 architecture.

Key Features

  • Architecture: Based on the Meta Llama 3.1 architecture
  • Base Model: Meta Llama 3.1 8B Instruct
  • File Type: F16
  • Quantization Version: 2
  • Attention Head Count: 32
  • Context Length: 131072
  • Embedding Length: 4096
  • Feed Forward Length: 14336
  • RoPE Dimension Count: 128
  • Vocabulary Size: 128256