37 4 months ago

IBM granite3.3:8b, quantized to Q2_K_L and Q3_K_S for GPU with 4gb Vram or less.

tools

4 months ago

17ced9a7b3f7 · 3.2GB

granite
·
8.17B
·
Q2_K
{{- /* ------ MESSAGE PARSING ------ */}} {{- /* Declare the prompt structure variables to be filled
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

Readme

No readme