doomgrave/
granite3.3

37 4 months ago

IBM granite3.3:8b, quantized to Q2_K_L and Q3_K_S for GPU with 4gb Vram or less.

tools

3 models

granite3.3:latest
4319f0881a19 • 3.6GB • 128K context window •
Text input • 4 months ago
granite3.3:Q2_K_L
17ced9a7b3f7 • 3.2GB • 128K context window •
Text input • 4 months ago
granite3.3:Q3_K_S
4319f0881a19 • 3.6GB • 128K context window •
Text input • 4 months ago