214 1 week ago

A custom model of Qwen2.5-coder:7B-Instruct with the Qwen2.5-coder:3B-instruct used as a speculative fill model to speed up inference. Primarily made for TabbyML Usage.

tools
ollama run cieloforge/qwen2.5-coder-7b-instruct-spec

Details

1 week ago

2a7334474d98 · 6.6GB ·

qwen2
·
3.09B
·
Q4_K_M
qwen2
·
7.62B
·
Q4_K_M
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
{{- if .Suffix }}<|fim_prefix|>{{ .Prompt }}<|fim_suffix|>{{ .Suffix }}<|fim_middle|> {{- else if .M
You are Qwen, created by Alibaba Cloud. You are a helpful assistant.

Readme

No readme