Jais Family Model Card

The Jais family of models is a comprehensive series of bilingual English-Arabic large language models (LLMs). These models are optimized to excel in Arabic while having strong English capabilities. We release two variants of foundation models that include:

• Models pre-trained from scratch (jais-family-*).
• Models pre-trained adaptively from Llama-2 (jais-adapted-*).

In this release, we introduce 20 models across 8 sizes, ranging from 590M to 70B parameters, trained on up to 1.6T tokens of Arabic, English, and code data. All pre-trained models in this series are instruction fine-tuned (*-chat) for dialog using a curated mix of Arabic and English instruction data.

We hope this extensive release will accelerate research in Arabic NLP, and enable numerous downstream applications for the Arabic speaking and bilingual community. The training and adaptation techniques we demonstrate successfully for Arabic models are extensible to other low and medium resource languages.

Jais Family Details

• Developed by: Inception, Cerebras Systems.
• Language(s): (NLP): Arabic (MSA) and English.
• Input: Text only data.
• Output: Model generates text.
• Model Sizes: 590M, 1.3B, 2.7B, 6.7B, 7B, 13B, 30B, 70B.
• Demo: Access the live demo here
• License: Apache 2.0

more details: https://huggingface.co/inceptionai/jais-adapted-7b-chat