vanilj / llama3.1-70b-iquants

Llama 3.1 70b IQs: IQ1_M, IQ2_M, IQ2_S, IQ2_XS, IQ2_XXS, IQ3_XS, IQ4_XS

tools

107 3 months ago

8 Tags
... /
params
56bb8bd477a5 · 96B
{
"stop": [
"<|start_header_id|>",
"<|end_header_id|>",
"<|eot_id|>"
]
}