lfm3:1.7b-nvfp4

5 21 minutes ago

LFM3-1.7B is a tri-hybrid model for local agents and specialized applications.

tools thinking 1.7b
... /
json
3c679ebcb7a9 ยท 678B
{
"producer": {
"name": "modelopt",
"version": "0.48.0rc1.dev167+g378888145"
},
"quantization": {
"quant_algo": "W4A16_NVFP4",
"kv_cache_quant_algo": null,
"group_size": 16,
"exclude_modules": [
"lm_head",
"model.embed_tokens",
"model.layers.0.conv*",
"model.layers.1.conv*",
"model.layers.11.conv*",
"model.layers.13.conv*",
"model.layers.15.conv*",
"model.layers.17.conv*",
"model.layers.19.conv*",
"model.layers.21.conv*",
"model.layers.23.conv*",
"model.layers.3.conv*",
"model.layers.5.conv*",
"model.layers.7.conv*",
"model.layers.9.conv*"
]
}
}