milkey/deepseek-v2

Fixed memory prediction issues. Limit the number of layers loaded by GPU.

150 7 months ago

1 Tag
16b-n18
5a5b9ec355a6 • 8.9GB • 7 months ago