13 Downloads Updated 2 months ago
Choose the model from the list and then use the link (or click on the copy icon next to it’s name) - The link on the main site in the top right will not work!!!
(Q4_K_L) - Quants made using imatrix option, uses Q8_0 for embed and output weights.
Original model: https://huggingface.co/TheDrummer/Anubis-70B-v1.1
Quants from: https://huggingface.co/bartowski/TheDrummer_Anubis-70B-v1.1-GGUF
CHECK OUT THIS BEST CHARACTER CHAT APP !!! Hammer AI (offline/local & online) - Chat with AI characters for free. Uncensored and private. https://www.hammerai.com/