Llama 3 8B CPT SEA-Lionv2.1 Instruct

SEA-LION is a collection of Large Language Models (LLMs) which has been pretrained and instruct-tuned for the Southeast Asia (SEA) region.

Llama 3 8B CPT SEA-Lionv2.1 Instruct is a multilingual model which has been fine-tuned with around 100,000 English instruction-completion pairs alongside a smaller pool of around 50,000 instruction-completion pairs from other ASEAN languages, such as Indonesian, Thai and Vietnamese. These instructions have been carefully curated and rewritten to ensure the model was trained on truly open, commercially permissive and high quality datasets.

Llama3 8B CPT SEA-Lionv2.1 Instruct has undergone additional supervised fine-tuning and alignment compared to the now deprecated Llama3 8B CPT SEA-Lionv2 Instruct. These improvements have increased the model’s capabilities in chat interactions and its ability to follow instructions accurately.

SEA-LION stands for Southeast Asian Languages In One Network.

• Developed by: Products Pillar, AI Singapore
• Funded by: Singapore NRF
• Model type: Decoder
• Languages: English, Indonesian, Thai, Vietnamese, Tamil
• License: Llama 3 Community License

For more details, please refer to AI Singapore’s HuggingFace page for this model. The original GGUF files can be obtained from this HuggingFace repository