supergoatscriptguy/ mnemonic:300m-f16

14 1 week ago

A small chat model written entirely in assembly, trained from scratch on one home graphics card. Outputs are not the best, but considering size and budget they're very good (also sometimes hilarious).

126m 300m
... /
params
401f1a944cfe ยท 87B
{
"num_ctx": 2048,
"stop": [
"<|end|>"
],
"temperature": 0.7,
"top_k": 64,
"top_p": 0.9
}