anaskhedr/ bonsai-27b-32k:latest

42 1 week ago

a no-edit fork of MichelRosselli/bonsai-27b where context size has been shrieked to fit 8GB vRam card.

vision tools thinking
... /
params
21da695a3d64 ยท 173B
{
"min_p": 0,
"num_ctx": 32768,
"repeat_penalty": 1,
"stop": [
"<|im_start|>",
"<|im_end|>",
"<|endoftext|>"
],
"temperature": 0.05,
"top_k": 20,
"top_p": 0.95
}