🦙 Taiwan LLM is an advanced language model tailored for Traditional Chinese, focusing on the linguistic and cultural contexts of Taiwan.
227 Pulls Updated 7 months ago
Updated 7 months ago
7 months ago
3272d402f116 · 7.4GB
Readme
Taiwan-LLM: Language Models for Taiwanese Culture
Taiwan LLM is an advanced language model tailored for Traditional Chinese, focusing on the linguistic and cultural contexts of Taiwan. Developed from a large base model, it’s enriched with diverse Taiwanese textual sources and refined through Supervised Fine-Tuning. This model excels in language understanding and generation, aligning closely with Taiwan’s cultural nuances. It demonstrates improved performance on various benchmarks like TC-Eval, showcasing its contextual comprehension and cultural relevance.
- Github: https://github.com/MiuLab/Taiwan-LLM
- HuggingFace: https://huggingface.co/yentinglin/Taiwan-LLM-13B-v2.0-chat
Key Features
Traditional Mandarin Support: The model is fine-tuned to understand and generate text in Traditional Mandarin, making it suitable for Taiwanese culture and related applications.
Instruction-Tuned: Further fine-tuned on conversational data to offer context-aware and instruction-following responses.
Performance on TC-Eval: Taiwan-LLM v2 13B shows a slight edge over ChatGPT-3 and achieves around 92% of ChatGPT-4’s performance in zh-tw benchmarks.
Usage
- Download and run model
ollama run wangrongsheng/taiwanllm-13b-v2.0-chat
# or
# single-round dialogue
ollama run wangrongsheng/taiwanllm-13b-v2.0-chat "NTU是什么?"
- Check model
ollama ls
wangrongsheng/taiwanllm-13b-v2.0-chat
will be listed with other models.
- Remove model
ollama rm wangrongsheng/taiwanllm-13b-v2.0-chat