sam860/
phi4-mini:3.8b-Q5_K_M

230 6 months ago

Phi-4-mini is the latest small LLM from microsoft. These are the quants that I like to use, that weren't uploaded to the main model by the ollama team.

tools 3.8b
... /
params
fe71ae8f5e90 · 34B
{
"num_ctx": 512,
"temperature": 0.3
}