latest
16GB
Tools
8B
58 Pulls Updated 9 days ago
Updated 10 days ago
10 days ago
3a377297df1b · 8.5GB
model
archllama
·
parameters8.03B
·
quantizationQ8_0
8.5GB
params
{"num_ctx":131072,"stop":["<|start_header_id|>","<|end_header_id|>","<|eot_id|>"]}
113B
template
{{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|>
{{- if .System }}
{{ .System }}
{{- end }}
{{- if .Tools }}
You are a helpful assistant with tool calling capabilities. When you receive a tool call response, use the output to format an answer to the orginal use question.
{{- end }}
{{- end }}<|eot_id|>
{{- range $i, $_ := .Messages }}
{{- $last := eq (len (slice $.Messages $i)) 1 }}
{{- if eq .Role "user" }}<|start_header_id|>user<|end_header_id|>
{{- if and $.Tools $last }}
Given the following functions, please respond with a JSON for a function call with its proper arguments that best answers the given prompt.
Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}. Do not use variables.
{{ $.Tools }}
{{- end }}
{{ .Content }}<|eot_id|>{{ if $last }}<|start_header_id|>assistant<|end_header_id|>
{{ end }}
{{- else if eq .Role "assistant" }}<|start_header_id|>assistant<|end_header_id|>
{{- if .ToolCalls }}
{{- range .ToolCalls }}{"name": "{{ .Function.Name }}", "parameters": {{ .Function.Arguments }}}{{ end }}
{{- else }}
{{ .Content }}{{ if not $last }}<|eot_id|>{{ end }}
{{- end }}
{{- else if eq .Role "tool" }}<|start_header_id|>ipython<|end_header_id|>
{{ .Content }}<|eot_id|>{{ if $last }}<|start_header_id|>assistant<|end_header_id|>
{{ end }}
{{- end }}
{{- end }}
1.4kB
Readme
Forge: A Meta Llama 3.1 Based Model
Overview
This model, Forge, is a powerful language model based on the well-established Meta Llama 3.1 architecture.
Key Features
- Architecture: Based on the Meta Llama 3.1 architecture
- Base Model: Meta Llama 3.1 8B Instruct
- File Type: F16
- Quantization Version: 2
- Attention Head Count: 32
- Context Length: 131072
- Embedding Length: 4096
- Feed Forward Length: 14336
- RoPE Dimension Count: 128
- Vocabulary Size: 128256