vanilj / llama-3-peach-instruct-4x8b-moe

This is a experimental 4x8B Llama 3 MoE

103 Pulls Updated 4 months ago

params

213fdae70cef · 110B

{ "stop": [ "num_keep 24", "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>" ] }