myaniu/
qwen2.5-1m:7b-instruct-q8_0

115.3K 7 months ago

Qwen2.5-7B/14B-Instruct-1M

tools 7b 14b

7 months ago

628c71193f56 · 8.1GB

model
qwen2
·
7.62B
·
Q8_0
system
You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
params
{ "num_ctx": 131072, "temperature": 0.5, "top_p": 0.95 }
template
{{- if .Suffix }}<|fim_prefix|>{{ .Prompt }}<|fim_suffix|>{{ .Suffix }}<|fim_middle|> {{- else if .M

Readme

Model creator: Qwen

Original model: Qwen2.5-7B-Instruct-1M

GGUF quantization: provided by bartowski based on llama.cpp release b4546

FROM https://huggingface.co/lmstudio-community/Qwen2.5-7B-Instruct-1M-GGUF