reecdev/ bytenet:latest

18 3 weeks ago

A bitnet-style LLM that runs on consumer hardware

21b
... /
params
5c7c8224de8e · 166B
{
"num_ctx": 131072,
"repeat_penalty": 1.1,
"stop": [
"<|begin_of_sentence|>",
"<|end_of_sentence|>",
"User:",
"Assistant:"
],
"temperature": 0.6,
"top_p": 0.9
}