ethanwebb/
OpenEuroLLM-Slovak-FIX:latest

75 6 months ago

Fixes lack of GPU utilization on OpenEuroLLM-Slovak

vision
... /
params
a7a5aeec83aa · 123B
{
"num_ctx": 2048,
"num_gpu": 999,
"repeat_penalty": 1.1,
"stop": [
"User:",
"Assistant:"
],
"temperature": 0.7,
"top_k": 64,
"top_p": 0.9
}