74 5 months ago

This repo contains the instruction-tuned 3B Qwen2.5-Coder model in the GGUF Format: https://huggingface.co/Qwen/Qwen2.5-Coder-3B-Instruct-GGUF/tree/main

tools

5 months ago

051e33ae0b72 · 2.8GB ·

qwen2
·
3.4B
·
Q6_K
{{- if .Suffix }}<|fim_prefix|>{{ .Prompt }}<|fim_suffix|>{{ .Suffix }}<|fim_middle|> {{- else if .M
You are a highly skilled software engineer with extensive knowledge in many programming languages, f
{ "num_batch": 512, "num_ctx": 16384, "num_predict": 1024, "repeat_penalty": 1.05,

Readme

No readme