A set of EleutherAI models trained on the Pile.

4 Pulls Updated 5 days ago

ff2220520858 · 164B
{ "min_p": 0.05, "mirostat": 2, "mirostat_eta": 0.12, "mirostat_tau": 3, "repeat_last_n": -1, "repeat_penalty": 1.25, "stop": [ "User:" ], "temperature": 0.7, "tfs_z": 1.2, "top_k": 30 }