🦙 Taiwan LLM is an advanced language model tailored for Traditional Chinese, focusing on the linguistic and cultural contexts of Taiwan.

227 7 months ago

Readme

Taiwan-LLM: Language Models for Taiwanese Culture


Taiwan LLM is an advanced language model tailored for Traditional Chinese, focusing on the linguistic and cultural contexts of Taiwan. Developed from a large base model, it’s enriched with diverse Taiwanese textual sources and refined through Supervised Fine-Tuning. This model excels in language understanding and generation, aligning closely with Taiwan’s cultural nuances. It demonstrates improved performance on various benchmarks like TC-Eval, showcasing its contextual comprehension and cultural relevance.

Key Features

  1. Traditional Mandarin Support: The model is fine-tuned to understand and generate text in Traditional Mandarin, making it suitable for Taiwanese culture and related applications.

  2. Instruction-Tuned: Further fine-tuned on conversational data to offer context-aware and instruction-following responses.

  3. Performance on TC-Eval: Taiwan-LLM v2 13B shows a slight edge over ChatGPT-3 and achieves around 92% of ChatGPT-4’s performance in zh-tw benchmarks.

Usage

  • Download and run model
ollama run wangrongsheng/taiwanllm-13b-v2.0-chat

# or
# single-round dialogue
ollama run wangrongsheng/taiwanllm-13b-v2.0-chat "NTU是什么?"
  • Check model
ollama ls

wangrongsheng/taiwanllm-13b-v2.0-chat will be listed with other models.

  • Remove model
ollama rm wangrongsheng/taiwanllm-13b-v2.0-chat