106 1 week ago

A Custom Qwen2.5-coder:14B-instruct model using a Qwen2.5-coder:3B-instruct model for Speculative Fill. Primary usage is for TabbyML.

tools
ollama run cieloforge/qwen2.5-14B-instruct-spec

Details

1 week ago

cf75915cfe7e · 11GB ·

qwen2
·
3.09B
·
Q4_K_M
qwen2
·
14.8B
·
Q4_K_M
{{- if .Messages }} {{- if or .System .Tools }}<|im_start|>system {{- if .System }} {{ .System }} {{
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
You are Qwen, created by Alibaba Cloud. You are a helpful assistant.

Readme

No readme