sammcj / qwen2.5-coder-7b-instruct

Qwen 2.5 Coder 7b Instruct

tools

540 Pulls Updated 2 months ago

Updated 2 months ago

2 months ago

4627e24f85f0 · 8.1GB

parameters7.62B

quantizationQ8_0

{"num_batch":1024,"num_ctx":32768,"stop":["\u003c|endoftext|\u003e"],"temperature":0.2,"top_p":0.8}

{{- if .Suffix }}<|fim_prefix|>{{ .Prompt }}<|fim_suffix|>{{ .Suffix }}<|fim_middle|> {{- else if .

Readme

https://huggingface.co/smcleod/Qwen2.5-Coder-7B-Instruct-Q8_0-GGUF/blob/main/qwen2.5-coder-7b-instruct-q8_0.gguf