476 9 months ago

unsloth's v2.0 dynamic quants of Llama-4-Scout-17B-16E-Instruct-GGUF, Q2_K_XL(2.71-bit)

tools
ollama run compcj/llama4-scout-ud-q2-k-xl

Details

9 months ago

c942ec33bf09 · 42GB ·

llama4
·
108B
·
Q2_K
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"
{{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{- if .System }} {{ .System }

Readme

No readme