43 1 week ago

RWKV-7 G1l by BlinkDL: 1.5B Q6_K and 2.9B/7.2B/13.3B Q4_K_M. 34,304-token training context. Apache 2.0.

1.5b 2.9b 7.2b 13.3b
dbdc4c71d507 ยท 144B
{
"frequency_penalty": 0.5,
"num_ctx": 34304,
"presence_penalty": 0.5,
"repeat_penalty": 1,
"stop": [
"\r\n\r\n"
],
"temperature": 1,
"top_k": 128,
"top_p": 0.5
}