tazarov/
all-minilm-l6-v2-f32:latest

11.3K 1 year ago

all-MiniLM-L6-v2

embedding

1 year ago

5828eca1915b · 91MB ·

model
bert
·
22.6M
·
F32
params
{ "num_ctx": 256 }
template
{{ .Prompt }}

Readme

https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2

git lfs install
git clone https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2
git clone git@github.com:ggerganov/llama.cpp.git
cd llama.cpp/
python -m venv venv
source venv/bin/activate
pip install -r requirements.txt
python convert-hf-to-gguf.py --outfile minilm.gguf --outtype f32 ../all-MiniLM-L6-v2/