sammcj/
qwen2.5-coder-7b-instruct:q8_0

1,543 1 year ago

Qwen 2.5 Coder 7b Instruct

tools

1 year ago

4627e24f85f0 · 8.1GB ·

model
qwen2
·
7.62B
·
Q8_0
params
{ "num_batch": 1024, "num_ctx": 32768, "stop": [ "<|endoftext|>" ], "tem
template
{{- if .Suffix }}<|fim_prefix|>{{ .Prompt }}<|fim_suffix|>{{ .Suffix }}<|fim_middle|> {{- else if .M

Readme

https://huggingface.co/smcleod/Qwen2.5-Coder-7B-Instruct-Q8_0-GGUF/blob/main/qwen2.5-coder-7b-instruct-q8_0.gguf