18 7 months ago

A strong Mixture-of-Experts (MoE) language model with 671B total parameters with 37B activated for each token.

Models

View all →

Readme

Note: this model requires Ollama 0.5.5 or later.

deepseek

DeepSeek-V3 achieves a significant breakthrough in inference speed over previous models. It tops the leaderboard among open-source models and rivals the most advanced closed-source models globally.

This is a modified version of deepseek-v3 Q4_K_M with context length set to 64k