63 8 months ago

A tiny 3.8B model designed to provide intelligence while being small.

64ffd9776d51 · 147B
{
"num_ctx": 4096,
"num_thread": 6,
"repeat_penalty": 1.2,
"stop": [
"<|end|>",
"<|user|>",
"<|assistant|>"
],
"temperature": 0.8
}