eslider/ bonsai-1.7b:latest

268 2 months ago

PrismML Bonsai 1.7B (GGUF Q1_0). Stock Ollama cannot load Q1_0 yet — run via bonsai-ollama proxy + Prism llama-server: https://github.com/eSlider/bonsai-ollama

... /
params
7e1994eeee8a · 60B
{
"num_ctx": 32768,
"temperature": 0.5,
"top_k": 20,
"top_p": 0.85
}