GitHub
187K
Download
Models
Docs
Pricing
Sign in
Download
Models
Docs
Pricing
Sign in
ahmgam
/
k2-horizon
46
Downloads
Updated
1 month ago
K2-Horizon-MoVA-36B-A4B is the sparse member of the K2-Horizon family: a Mixture-of-Experts model with Mixture-of-Values attention (MoVA) that stores 36B parameters and runs 4B per token.
K2-Horizon-MoVA-36B-A4B is the sparse member of the K2-Horizon family: a Mixture-of-Experts model with Mixture-of-Values attention (MoVA) that stores 36B parameters and runs 4B per token.
Cancel
36b
Name
1 model
Size / Usage
Context
Input
k2-horizon:36b
15d5db55af40
• 22GB • 512K context window •
Text input • 1 month ago
Text input • 1 month ago
k2-horizon:36b
22GB
512K
Text
15d5db55af40
· 1 month ago