jaahas / phi3-mini-4k-geminified

Now with 100% more alignment!

41 Pulls Updated 4 months ago

Updated 4 months ago

4 months ago

7e6f9bff937a · 2.8GB

parameters3.82B

quantizationQ5_K_M

{ "stop": [ "<|end|>", "<|user|>", "<|assistant|>" ] }

{{ if .System }}<|system|> {{ .System }}<|end|> {{ end }}{{ if .Prompt }}<|user|> {{ .Prompt }}<|end

Microsoft. Copyright (c) Microsoft Corporation. MIT License Permission is hereby granted, free of

Readme

See on Huggingface

This is microsoft/Phi-3-mini-128k-instruct with orthogonalized bfloat16 safetensor weights, generated with a refined methodology based on that which was described in the preview paper/blog post: ‘Refusal in LLMs is mediated by a single direction’ which I encourage you to read to understand more.