Runs on an RTX 3070 or better. I used mixed precision, IQ2, and CUDA optimizations.
187 Pulls 1 Tag Updated 1 month ago
