qllama/bge-reranker-v2-m3

qllama/ bge-reranker-v2-m3

60.4K Downloads Updated 11 months ago

quantize https://huggingface.co/BAAI/bge-reranker-v2-m3 to f16 / q8_0 (latest) / q4_k_m

embedding

ollama pull qllama/bge-reranker-v2-m3

curl http://localhost:11434/api/embed \
  -d '{
    "model": "qllama/bge-reranker-v2-m3",
    "input": "Why is the sky blue?"
  }'

import ollama

response = ollama.embed(
    model='qllama/bge-reranker-v2-m3',
    input='The sky is blue because of Rayleigh scattering',
)
print(response.embeddings)

import ollama from 'ollama'

const response = await ollama.embed({
  model: 'qllama/bge-reranker-v2-m3',
  input: 'The sky is blue because of Rayleigh scattering',
})
console.log(response.embeddings)

Models

View all →

Name

4 models

Size

Context

Input

bge-reranker-v2-m3:latest

636MB · 8K context window · Text · 11 months ago

bge-reranker-v2-m3:latest

636MB

Text

bge-reranker-v2-m3:q4_k_m

438MB · 8K context window · Text · 11 months ago

bge-reranker-v2-m3:q4_k_m

438MB

Text

bge-reranker-v2-m3:q8_0

636MB · 8K context window · Text · 11 months ago

bge-reranker-v2-m3:q8_0

636MB

Text

bge-reranker-v2-m3:f16

1.2GB · 8K context window · Text · 11 months ago

bge-reranker-v2-m3:f16

1.2GB

Text

Readme

No readme