19 1 week ago

pulled as BF16, vocab slice (combined_en_huge) requant to IQ4_NL (combined_en_huge) -- (English + Coding focus) - ~20% faster than Q4_K_M

ollama run dlasher/LFM3-1.7B-ENG:IQ4_NL

Details

1 week ago

12327bc806b0 · 938MB

lfm3
·
1.6B
·
IQ4_NL
{ "min_p": 0.05, "num_batch": 2048, "num_ctx": 262144, "presence_penalty": 0, "r
{{- if .System }}<|im_start|>system {{ .System }}<|im_end|> {{- end }} {{- range .Messages }} {{- if

Readme

No readme