aga/ OLMoE:7b

140 1 year ago

A Mixture-of-Experts LLM with 1B active and 7B total parameters.

7b
... /
params
4134f3eb0516 · 81B
{
"stop": [
"<|system|>",
"<|user|>",
"<|assistant|>"
]
}