granite3-dense

The IBM Granite 2B and 8B models are designed to support tool-based use cases and support for retrieval augmented generation (RAG), streamlining code generation, translation and bug fixing.

tools 2b 8b

23.3K Pulls Updated 3 days ago

33 Tags

latest

5c2e6f3112f4 • 1.6GB • 3 days ago

199456d876ee • 4.9GB • 3 days ago

2b-instruct-fp16

24e5c0a35f78 • 5.3GB • 3 days ago

2b-instruct-q2_K

2261d92d6175 • 1.0GB • 3 days ago

2b-instruct-q3_K_L

201ccf1522e8 • 1.4GB • 3 days ago

2b-instruct-q3_K_M

c08ae454856c • 1.3GB • 3 days ago

2b-instruct-q3_K_S

7c6af70b9f11 • 1.2GB • 3 days ago

2b-instruct-q4_0

dd4a07b9e1b7 • 1.5GB • 3 days ago

2b-instruct-q4_1

e12ad0fad2ad • 1.7GB • 3 days ago

2b-instruct-q4_K_M

5c2e6f3112f4 • 1.6GB • 3 days ago

2b-instruct-q4_K_S

0f87f54eb387 • 1.5GB • 3 days ago

2b-instruct-q5_0

db3fbcdec89b • 1.8GB • 3 days ago

2b-instruct-q5_1

bc5ed577d64f • 2.0GB • 3 days ago

2b-instruct-q5_K_M

dcace13d6d34 • 1.9GB • 3 days ago

2b-instruct-q5_K_S

be9d8efefd30 • 1.8GB • 3 days ago

2b-instruct-q6_K

7f374efdad9b • 2.2GB • 3 days ago

2b-instruct-q8_0

f35cd2e1e433 • 2.8GB • 3 days ago

8b-instruct-fp16

d3a4062e339e • 16GB • 3 days ago

8b-instruct-q2_K

2ea57f8bc8fd • 3.1GB • 3 days ago

8b-instruct-q3_K_L

c74b04a2513f • 4.3GB • 3 days ago

8b-instruct-q3_K_M

c1a94d47b25c • 4.0GB • 3 days ago

8b-instruct-q3_K_S

4c5f0dba11a8 • 3.6GB • 3 days ago

8b-instruct-q4_0

16473222519f • 4.7GB • 3 days ago

8b-instruct-q4_1

8a47472a11f2 • 5.1GB • 3 days ago

8b-instruct-q4_K_M

199456d876ee • 4.9GB • 3 days ago

8b-instruct-q4_K_S

8fc1ce76b8f2 • 4.7GB • 3 days ago

8b-instruct-q5_0

449cddb1864d • 5.6GB • 3 days ago

8b-instruct-q5_1

ae4ab94be005 • 6.1GB • 3 days ago

8b-instruct-q5_K_M

e85361d1973c • 5.8GB • 3 days ago

8b-instruct-q5_K_S

49055e666925 • 5.6GB • 3 days ago

8b-instruct-q6_K

ec258d53940b • 6.7GB • 3 days ago

8b-instruct-q8_0

f1466e70a7be • 8.7GB • 3 days ago