eas / codellama

Codelama with 16k context unlocked in modelfile

217 Pulls Updated 11 months ago

Updated 11 months ago

11 months ago

be95e5b84e7f · 16GB

parameters33.7B

quantizationQ3_K_M

[INST] <<SYS>>{{ .System }}<</SYS>> {{ .Prompt }} [/INST]

{"num_ctx":16384,"num_gqa":8,"rope_frequency_base":1000000,"stop":["[INST]","[/INST]","\u003c\u003cS

Readme

13b version is q4_K_M quantization

34b version is q3_K_M quantization