Yi-1.5 is an upgraded version of Yi, 9B and 34B with context windows 16K here.
309 Pulls Updated 5 months ago
Readme
Models
Intro
Yi-1.5是Yi的升级版。它以500B TOKENS 的高质量语料库在Yi上不断进行预训练，并在3M多样化的微调样本上进行微调。
与Yi相比，Yi-1.5在编码、数学、推理和指导遵循能力方面表现出更强，同时在语言理解、常识推理和阅读理解方面仍然保持出色的能力。
Yi-1.5 is an upgraded version of Yi. It is continuously pre-trained on Yi with a high-quality corpus of 500B tokens and fine-tuned on 3M diverse fine-tuning samples.
Compared with Yi, Yi-1.5 delivers stronger performance in coding, math, reasoning, and instruction-following capability, while still maintaining excellent capabilities in language understanding, commonsense reasoning, and reading comprehension.