oamazonasgabriel/ lfm2.5-2.6b:q4_k_m-8gbGPU

81 11 hours ago

LFM2.5-2.6B by Liquid AI — deploy agents everywhere. A 2.6B dense reasoning model (Q4_K_M, ~1.7 GB) with native tool calling, 128K context, and 16-language support. Runs on any 8 GB GPU.

... /
params
e647774f9e56 · 240B
{
"frequency_penalty": 0,
"min_p": 0,
"num_batch": 512,
"num_ctx": 32768,
"num_gpu": 99,
"num_thread": 8,
"presence_penalty": 0,
"repeat_penalty": 1.1,
"stop": [
"im_start",
"im_end",
"tool_call_start",
"tool_call_end"
],
"temperature": 0.1,
"top_k": 50,
"top_p": 0.9
}