265 1 year ago

Unofficial Llama-3-Typhoon-1.5-8B-instruct Q4_K_M Quantization (https://huggingface.co/scb10x/llama-3-typhoon-v1.5-8b-instruct)

{{- range .Messages }}<|start_header_id|>{{ .Role }}<|end_header_id|>
{{ .Content }}<|eot_id|>
{{- end }}<|start_header_id|>assistant<|end_header_id|>