takenusername/
tinyllm:latest

44 8 months ago

Should be the fastest and smartest llm for the raspberry pi 4b, 5, and newer models if any

8 months ago

d62353bcb81e · 2.6GB

model
llama
·
3.43B
·
Q4_0
model
llama
·
1.1B
·
Q4_0
template
{{- if .System }}<|im_start|>system {{ .System }} {{ end }} {{- if .Prompt }}<|im_start|>user {{ .Pr
system
You are an AI assistant optimized for older devices or devices with limited resources, designed to p
params
{ "min_p": 0.05, "mirostat": 1, "mirostat_eta": 0.1, "mirostat_tau": 5, "num_ctx

Readme

This is a combination of TinyLlama and Orca Mini.

Optimized for use on the raspberry pi 5 or newer not recommended for use on the raspberry pi 4b or lower