sammcj/qwen2.5-coder-7b-instruct:q8_0

sammcj/

qwen2.5-coder-7b-instruct

Qwen 2.5 Coder 7b Instruct

tools

1,110 Pulls Updated 6 months ago

Updated 6 months ago

6 months ago

4627e24f85f0 · 8.1GB

parameters7.62B

quantizationQ8_0

{ "num_batch": 1024, "num_ctx": 32768, "stop": [ "<|endoftext|>" ], "tem

{{- if .Suffix }}<|fim_prefix|>{{ .Prompt }}<|fim_suffix|>{{ .Suffix }}<|fim_middle|> {{- else if .

Readme

https://huggingface.co/smcleod/Qwen2.5-Coder-7B-Instruct-Q8_0-GGUF/blob/main/qwen2.5-coder-7b-instruct-q8_0.gguf