takenusername/
tinyllm-broken:latest

1 8 months ago

I dont know why it keeps responding to its system prompt... its broken

... /
params
4a3628899e10 · 268B
{
"min_p": 0.01,
"mirostat": 1,
"mirostat_eta": 0.05,
"mirostat_tau": 4,
"num_ctx": 512,
"num_predict": 30,
"num_thread": 4,
"repeat_last_n": 32,
"repeat_penalty": 1,
"seed": 42,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.6,
"tfs_z": 1,
"top_k": 15,
"top_p": 0.85
}