Qwen1.5-MoE is a transformer-based MoE decoder-only language model pretrained on a large amount of data.
2 Pulls Updated 2 months ago
