-
qwen2.5-coder-7b-instruct-spec
A custom model of Qwen2.5-coder:7B-Instruct with the Qwen2.5-coder:3B-instruct used as a speculative fill model to speed up inference. Primarily made for TabbyML Usage.
tools214 Pulls 1 Tag Updated 1 week ago
-
qwen2.5-14B-instruct-spec
A Custom Qwen2.5-coder:14B-instruct model using a Qwen2.5-coder:3B-instruct model for Speculative Fill. Primary usage is for TabbyML.
tools106 Pulls 1 Tag Updated 1 week ago
-
qwen2.5-coder-7b-instruct-3b-1.5b-spec
A Custom Model using Qwen2.5-coder:7B-instruct as a base, and adding my custom Qwen2.5-coder-3b-instuct-spec model which is a Qwen2.5-coder:3b-instruct model using qwen2.5-coder:1.5b model as speculative fill. VERY WIP...
tools61 Pulls 1 Tag Updated 1 week ago
-
deepseek-coder-6.7b-spec
A custom Deepseek-coder:6.7b model with Deepseek-coder:1.3b as a speculative fill model to speed up inference. Primarily built for TabbyML usage.
55 Pulls 1 Tag Updated 1 week ago
-
qwen2.5-coder-3b-instruct-spec
A Custom Qwen2.5-coder:3b-instruct using a Qwen2.5-coder:1.5b model as speculative fill. Primary usage for this model is TabbyML.
tools38 Pulls 1 Tag Updated 1 week ago