-
qwen2.5-coder-7b-instruct-spec
A custom model of Qwen2.5-coder:7B-Instruct with the Qwen2.5-coder:3B-instruct used as a speculative fill model to speed up inference. Primarily made for TabbyML Usage.
tools1,092 Pulls 1 Tag Updated 1 month ago
-
qwen2.5-14B-instruct-spec
A Custom Qwen2.5-coder:14B-instruct model using a Qwen2.5-coder:3B-instruct model for Speculative Fill. Primary usage is for TabbyML.
tools468 Pulls 1 Tag Updated 1 month ago
-
Deepseek-r1-8b-spec
A Deepseek-R1:8b model with Deepseek-R1:1.5b model as drafting model
thinking185 Pulls 1 Tag Updated 4 weeks ago
-
deepseek-coder-6.7b-spec
A custom Deepseek-coder:6.7b model with Deepseek-coder:1.3b as a speculative fill model to speed up inference. Primarily built for TabbyML usage.
149 Pulls 1 Tag Updated 1 month ago
-
qwen2.5-coder-3b-instruct-spec
A Custom Qwen2.5-coder:3b-instruct using a Qwen2.5-coder:1.5b model as speculative fill. Primary usage for this model is TabbyML.
tools145 Pulls 1 Tag Updated 1 month ago
-
Deepseek-r1-7b-spec
A Deepseek-r1:7b Model with Deepseek-r1:8b temp and TopP, while having Deepseek-r1:1.5b as a speculative draft model
thinking132 Pulls 1 Tag Updated 4 weeks ago