beltranaceves/ llama3.1:8b-instruct-q4-small

43 2 months ago

Quantized variants of llama3.1:8b-instruct-fp16 for the purpose of tesing in ContextAgentBench

tools
ollama run beltranaceves/llama3.1:8b-instruct-q4-small

Details

2 months ago

b17954bd5dbe · 4.7GB ·

llama
·
8.03B
·
Q4_K_S
LLAMA 3.1 COMMUNITY LICENSE AGREEMENT Llama 3.1 Version Release Date: July 23, 2024 “Agreement”
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"
{{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{- if .System }} {{ .System }

Readme

No readme