wangrongsheng/ taiwanllm-13b-v2.0-chat

🦙 Taiwan LLM is an advanced language model tailored for Traditional Chinese, focusing on the linguistic and cultural contexts of Taiwan.

125 Pulls Updated 7 weeks ago

1 Tag

7 weeks ago

3272d402f116 · 7.4GB

model
llama
·
13B
·
4-bit
params
{"stop":["<|system|>","<|user|>","<|assistant|>"]}
template
<|system|> {{ .System }} <|user|> {{ .Prompt }} <|assistant|>
system
你是一個人工智慧助理

Readme

Taiwan-LLM: Language Models for Taiwanese Culture


Taiwan LLM is an advanced language model tailored for Traditional Chinese, focusing on the linguistic and cultural contexts of Taiwan. Developed from a large base model, it’s enriched with diverse Taiwanese textual sources and refined through Supervised Fine-Tuning. This model excels in language understanding and generation, aligning closely with Taiwan’s cultural nuances. It demonstrates improved performance on various benchmarks like TC-Eval, showcasing its contextual comprehension and cultural relevance.

Key Features

  1. Traditional Mandarin Support: The model is fine-tuned to understand and generate text in Traditional Mandarin, making it suitable for Taiwanese culture and related applications.

  2. Instruction-Tuned: Further fine-tuned on conversational data to offer context-aware and instruction-following responses.

  3. Performance on TC-Eval: Taiwan-LLM v2 13B shows a slight edge over ChatGPT-3 and achieves around 92% of ChatGPT-4’s performance in zh-tw benchmarks.

Usage

  • Download and run model
ollama run wangrongsheng/taiwanllm-13b-v2.0-chat

# or
# single-round dialogue
ollama run wangrongsheng/taiwanllm-13b-v2.0-chat "NTU是什么？"
  • Check model
ollama ls

wangrongsheng/taiwanllm-13b-v2.0-chat will be listed with other models.

  • Remove model
ollama rm wangrongsheng/taiwanllm-13b-v2.0-chat