14 1 year ago

Joined the gguf's for https://huggingface.co/bartowski/Athene-V2-Agent-GGUF with `llama-gguf-split --merge`, then created this model using the Modelfile from the Q4_K_M version I got by pulling `ollama run hf.co/bartowski/Athene-V2-Agent-GGUF:Q4_K_M`

tools
ollama run presidenten/athene-v2-agent:72b-q5_K_M

Details

1 year ago

bfd3d815ea6d · 54GB

qwen2
·
72.7B
·
Q5_K_M
{{- if .Suffix }}<|fim_prefix|>{{ .Prompt }}<|fim_suffix|>{{ .Suffix }}<|fim_middle|> {{- else if .M

Readme

No readme