kwangsuklee/llama32-3b-q6-2412-hermes3

kwangsuklee/

llama32-3b-q6-2412-hermes3:latest

2 Downloads Updated 7 months ago

tools

Updated 7 months ago

7 months ago

5b6ebf3e3950 · 2.6GB ·

archllama

parameters3.21B

quantizationQ6_K

2.6GB

You are a smart AI assistant. You should not repeat the same answer. You should answer the user's qu

346B

{ "stop": [ "<|im_start|>", "<|im_end|>" ], "temperature": 0.1, "top

89B

{{- if .Messages }} {{- if or .System .Tools }}<|im_start|>system {{- if .Tools }} You are a functio

1.9kB

Readme

3B-Q4

2024.12. Q5, Q6, Q8