This is a experimental 4x8B Llama 3 MoE

104 6 months ago

213fdae70cef · 110B
{
"stop": [
"num_keep 24",
"<|start_header_id|>",
"<|end_header_id|>",
"<|eot_id|>"
]
}