supergoatscriptguy/ mnemonic:126m-f16

14 1 week ago

A small chat model written entirely in assembly, trained from scratch on one home graphics card. Outputs are not the best, but considering size and budget they're very good (also sometimes hilarious).

126m 300m
... /
params
896b7a4f664b ยท 87B
{
"num_ctx": 1024,
"stop": [
"<|end|>"
],
"temperature": 0.7,
"top_k": 64,
"top_p": 0.9
}