3 models
(Updated: May 2024) https://huggingface.co/fearlessdots/WizardLM-2-7B-abliterated-GGUF
Fixed num_ctx to 32768. This WizardLM-2 7B model is ready to use for full model's 32k contexts window.
This is the WizardLM-2-7B model with orthogonalized bfloat16 safetensor weights, based on the implementation by @failspy