OblivionAI/ Fast-0.11:latest

2 2 days ago

Oblivion AI, Model Fast!

tools
... /
params
af27fc8fd990 · 221B
{
"num_ctx": 32768,
"num_gpu": 99,
"num_predict": 8192,
"num_thread": 8,
"repeat_penalty": 1.1,
"stop": [
"<|start_header_id|>",
"<|end_header_id|>",
"<|eot_id|>"
],
"temperature": 0.7,
"top_k": 40,
"top_p": 0.9
}