144 1 month ago

pulled as BF16, requant to IQ4_NL, with combined_en_huge as imatrix dataset (English + Coding focus)

vision
ollama run dlasher/Qwen3.8-27B-GGUF:IQ4_NL

Details

1 month ago

bc0882191cfa · 17GB

qwen35
·
27.3B
·
IQ4_NL
clip
·
461M
·
BF16
{ "min_p": 0.05, "num_batch": 2048, "num_ctx": 262144, "presence_penalty": 0, "r
{{- if .System }}<|im_start|>system {{ .System }}<|im_end|> {{- end }} {{- range .Messages }} {{- if

Readme