46 1 month ago

K2-Horizon-MoVA-36B-A4B is the sparse member of the K2-Horizon family: a Mixture-of-Experts model with Mixture-of-Values attention (MoVA) that stores 36B parameters and runs 4B per token.

36b
ollama run ahmgam/k2-horizon:36b

Models

View all →

1 model

k2-horizon:36b

22GB · 512K context window · Text · 1 month ago

Readme