PRFD/ croissant-llm:chat-q4_K_M

409 1 year ago

A 1.3B language model pretrained on a set of 3T English and French tokens, fully open-sourced bilingual model that runs swiftly on consumer-grade local hardware.

... /
params
09bce20119fd ยท 122B
{
"repeat_penalty": 1.05,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.3,
"top_k": 40,
"top_p": 0.9
}