6,308 1 year ago

Abliterated version of Google's Gemma 2 9B

Models

View all →

Readme

Abliterated Gemma 2 9B

See on Huggingface

Abliterated version of Google’s Gemma 2 9B.

The abliteration script is based on code from the blog post and heavily uses TransformerLens. The only major difference from the code used for Llama is scaling the embedding layer back.