jefferyb / granite

4-bit quantized version of instructlab/granite-7b-lab https://huggingface.co/instructlab/granite-7b-lab-GGUF

7B

51 Pulls Updated 5 months ago

granite:latest ... /

params

90ac3ac954d8 · 99B

{ "num_ctx": 2048, "stop": [ "<|im_end|>", "<|endoftext|>", "</|im_end|>" ] }