takenusername/ tinyllm-2:latest

581 1 year ago

This IS the fastest and smartest (probably) llm for the raspberry pi 4b, 5, and newer models if any

... /
params
c1f5189db19e · 269B
{
"min_p": 0.05,
"mirostat": 1,
"mirostat_eta": 0.1,
"mirostat_tau": 5,
"num_ctx": 1024,
"num_predict": 42,
"num_thread": 4,
"repeat_last_n": 64,
"repeat_penalty": 1.1,
"seed": 42,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.7,
"tfs_z": 1,
"top_k": 25,
"top_p": 0.9
}