andrewcanis/
command-r

592 1 year ago

Command-R is a 35B model with 128k context length from Cohere

Models

View all →

14 models

command-r:latest

20GB · 128K context window · Text · 1 year ago

command-r:q2_K

14GB · 128K context window · Text · 1 year ago

command-r:q3_K_S

16GB · 128K context window · Text · 1 year ago

command-r:q3_K_M

18GB · 128K context window · Text · 1 year ago

command-r:q3_K_L

19GB · 128K context window · Text · 1 year ago

command-r:q4_0

20GB · 128K context window · Text · 1 year ago

command-r:q4_K_S

20GB · 128K context window · Text · 1 year ago

command-r:q4_K_M

22GB · 128K context window · Text · 1 year ago

command-r:q5_0

24GB · 128K context window · Text · 1 year ago

command-r:q5_K_S

24GB · 128K context window · Text · 1 year ago

command-r:q5_K_M

25GB · 128K context window · Text · 1 year ago

command-r:q6_K

29GB · 128K context window · Text · 1 year ago

command-r:q8_0

37GB · 128K context window · Text · 1 year ago

command-r:fp16

70GB · 128K context window · Text · 1 year ago

Readme

Command-R a 35B model from Cohere that has a 128k context length aimed for RAG and Tool Use. See details here: https://huggingface.co/CohereForAI/c4ai-command-r-v01

License:

This model is governed by a CC-BY-NC License with an acceptable use addendum, and also requires adhering to C4AI’s Acceptable Use Policy.