Runs on an RTX 3070 or better. I used mixed precision, IQ2, and CUDA optimizations.
252 Pulls 1 Tag Updated 2 months ago
