model

archllama

·

parameters33.7B

·

quantizationQ4_K_M

20GB

template

Question: {{ .Prompt }} Reply:

36B

params

{ "rope_frequency_base": 1000000, "stop": [ "### User Message", "</s>",

88B