The Llama3-TAIDE model was developed and built by the National Applied Research Laboratories. This version was scaled to 32k using RoPE scaling.

97 6 months ago

{
"num_keep": 24,
"stop": [
"<|start_header_id|>",
"<|end_header_id|>",
"\"<|eot_id|>\""
]
}