myaniu/
qwen2.5-1m:latest

115.3K 7 months ago

Qwen2.5-7B/14B-Instruct-1M

tools 7b 14b

7 months ago

9d5daa5ceeff · 4.7GB

model
qwen2
·
7.62B
·
Q4_K_M
template
{{- if .Suffix }}<|fim_prefix|>{{ .Prompt }}<|fim_suffix|>{{ .Suffix }}<|fim_middle|> {{- else if .M
system
You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
params
{ "num_ctx": 65536, "temperature": 0.5, "top_p": 0.95 }

Readme

Model creator: Qwen

Original model: Qwen2.5-7B-Instruct-1M

GGUF quantization: provided by bartowski based on llama.cpp release b4546

FROM https://huggingface.co/lmstudio-community/Qwen2.5-7B-Instruct-1M-GGUF