94 Downloads Updated 5 months ago
ollama run reecdev/bytenet:21b
Updated 5 months ago
5 months ago
1c4fbe057bc0 · 4.5GB
ByteNet is a 21 billion parameter LLM based on ERNIE 4.5 that can run on consumer GPUs with less than 6 GB of VRAM using aggressive compression techniques.
Pull ByteNet and run on GPU (min vram: 5 GB)
ollama run reecdev/bytenet