12 1 week ago

Isolate the response only for translation purposes

beb6ed2f6764 · 112B
{
"num_ctx": 8192,
"num_predict": 4096,
"stop": [
"<end_of_turn>"
],
"temperature": 0.2,
"top_k": 64,
"top_p": 0.9
}