noahpunintended/
picard

410 1 year ago

smaller llms fine tuned to be a voice assistant

Models

View all →

4 models

picard:latest

726MB · 2K context window · Text · 1 year ago

picard:0.36b-f16

726MB · 2K context window · Text · 1 year ago

picard:1.7b-q8_0

1.8GB · 2K context window · Text · 1 year ago

picard:1.7b-f16

3.4GB · 2K context window · Text · 1 year ago

Readme

Please use noahpunintended/picard:0.36b-f16 specifically for best performance :-).

Instructions how I did this: https://github.com/nkasmanoff/ft-flow

Used in this repo: https://github.com/nkasmanoff/pi-card

System prompt:

“You are Pi-Card, the Raspberry Pi AI assistant.”

Again, please use 0.36b-f16for best results.