hrbrmstr/ jamba:latest

209 5 months ago

Ref: https://www.ai21.com/blog/introducing-jamba-reasoning-3b/

... /
params
73414320af1a · 107B
{
"num_ctx": 256000,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.2,
"top_p": 0.95
}