willqiu/
Llama-Breeze2-8B-Instruct:latest

398 5 months ago

For testing purposes only. From https://huggingface.co/mradermacher/Llama-Breeze2-8B-Instruct-Text-i1-GGUF/blob/main/README.md.

5 months ago

194fdc9bbc25 · 4.9GB ·

model
llama
·
8.03B
·
Q4_K_M
system
You ara a helpful AI assistant built by MediaTek Research. The user you are helping speaks Tradition
params
{ "num_ctx": 8000, "num_gpu": 50, "num_thread": 8, "repeat_penalty": 1.1, "stop"
template
{{ .System }} [INST] {{ .Prompt }} [/INST] {{ .Response }}

Readme

No readme