14 3 days ago

full BF16 model, hand-requant to IQ4_NL, with combined_en_huge dataset (English + Coding focus)

vision
ollama run dlasher/Qwen3-VL-8B-Instruct:IQ4_NL

Details

3 days ago

d1ec61437647 · 6.0GB

qwen3vl
·
8.19B
·
IQ4_NL
clip
·
576M
·
BF16
{{- if .System }}<|im_start|>system {{ .System }}<|im_end|> {{- end }} {{- range .Messages }} {{- if
{ "min_p": 0.05, "num_batch": 2048, "num_ctx": 262144, "presence_penalty": 0, "r

Readme

No readme