wangrongsheng / taiwanllm-7b-v2.1-chat

Taiwan-LLM: Language Models for Taiwanese Culture

Taiwan LLM is an advanced language model tailored for Traditional Chinese, focusing on the linguistic and cultural contexts of Taiwan. Developed from a large base model, it’s enriched with diverse Taiwanese textual sources and refined through Supervised Fine-Tuning. This model excels in language understanding and generation, aligning closely with Taiwan’s cultural nuances. It demonstrates improved performance on various benchmarks like TC-Eval, showcasing its contextual comprehension and cultural relevance.

• Github: https://github.com/MiuLab/Taiwan-LLM
• HuggingFace: https://huggingface.co/yentinglin/Taiwan-LLM-7B-v2.1-chat

Key Features

1. Traditional Mandarin Support: The model is fine-tuned to understand and generate text in Traditional Mandarin, making it suitable for Taiwanese culture and related applications.

2. Instruction-Tuned: Further fine-tuned on conversational data to offer context-aware and instruction-following responses.

3. Performance on TC-Eval: Taiwan-LLM v2 13B shows a slight edge over ChatGPT-3 and achieves around 92% of ChatGPT-4’s performance in zh-tw benchmarks.

Usage

• Download and run model

ollama run wangrongsheng/taiwanllm-7b-v2.1-chat

# or
# single-round dialogue
ollama run wangrongsheng/taiwanllm-7b-v2.1-chat "NTU是什么？"

• Check model

ollama ls

wangrongsheng/taiwanllm-7b-v2.1-chat will be listed with other models.

• Remove model

ollama rm wangrongsheng/taiwanllm-7b-v2.1-chat