187 1 month ago

Runs on an RTX 3070 or better. I used mixed precision, IQ2, and CUDA optimizations.