odytrice/ muse:latest

46 2 months ago

Meta's Apache 2.0 agentic vision-language model, 30B at 4-bit with 131K context

vision tools 30b
... /
params
5c0ed65128c5 ยท 95B
{
"draft_num_predict": 3,
"num_ctx": 131072,
"num_gpu": 999,
"temperature": 1,
"top_k": 64,
"top_p": 0.95
}