scb10x/
llama3.2-typhoon2-3b-instruct:latest

571 9 months ago

Typhoon2 3B Instruct - 3B parameters Thai / English bilingual LLM.

tools

9 months ago

bead215ffeaa · 2.0GB ·

model
llama
·
3.21B
·
Q4_K_M
system
You are a male AI assistant named Typhoon created by SCB 10X to be helpful, harmless, and honest. Ty
params
{ "num_ctx": 8192, "temperature": 0.4 }
template
{{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{- if .System }} {{ .System }

Readme

Llama3.2-Typhoon2-3B: Thai Large Language Model (Instruct) - Q4_K_M quantized

Llama3.2-Typhoon2-3B-instruct is a instruct Thai 🇹🇭 large language model with 3 billion parameters, and it is based on Llama3.2-3B.

*To acknowledge Meta’s effort in creating the foundation model and to comply with the license, we explicitly include “llama-3.2” in the model name.

Run

ollama run scb10x/llama3.2-typhoon2-3b-instruct

Performance

Instruction-Following & Function Call Performance

Typhoon General Performance

Detail Performance

Model IFEval - TH IFEval - EN MT-Bench TH MT-Bench EN Thai Code-Switching (t=0.7) Thai Code-Switching (t=1.0) FunctionCall-TH FunctionCall-EN
Typhoon2 Llama3.2 3B Instruct 68.36% 72.18% 5.3352 7.206 99.2% 96% 71.36% 75.90%
Qwen2.5 3B Instruct 58.86% 67.25% 4.6263 7.846 78.6% 38% 53.78% 62.55%
Llama3.2 3B Instruct 44.84% 71.98% 4.3241 7.725 93.8% 21.2% 35.43% 53.87%

Link

Arxiv

Huggingface