265 1 year ago

Unofficial Llama-3-Typhoon-1.5-8B-instruct Q4_K_M Quantization (https://huggingface.co/scb10x/llama-3-typhoon-v1.5-8b-instruct)

{
"stop": [
"<|start_header_id|>",
"<|end_header_id|>",
"<|eot_id|>"
]
}