willqiu/
Llama-Breeze2-8B-Instruct:latest

398 5 months ago

For testing purposes only. From https://huggingface.co/mradermacher/Llama-Breeze2-8B-Instruct-Text-i1-GGUF/blob/main/README.md.

... /
params
b3fcf5322aff · 126B
{
"num_ctx": 8000,
"num_gpu": 50,
"num_thread": 8,
"repeat_penalty": 1.1,
"stop": [
"[INST]"
],
"temperature": 0.01,
"top_k": 1,
"top_p": 0.01
}