qllama/bce-reranker-base

qllama/ bce-reranker-base_v1

13.8K Downloads Updated 11 months ago

quantize https://huggingface.co/maidalun1020/bce-reranker-base_v1 to f16 / q8_0 (latest) / q4_k_m

embedding

ollama pull qllama/bce-reranker-base_v1

curl http://localhost:11434/api/embed \
  -d '{
    "model": "qllama/bce-reranker-base_v1",
    "input": "Why is the sky blue?"
  }'

import ollama

response = ollama.embed(
    model='qllama/bce-reranker-base_v1',
    input='The sky is blue because of Rayleigh scattering',
)
print(response.embeddings)

import ollama from 'ollama'

const response = await ollama.embed({
  model: 'qllama/bce-reranker-base_v1',
  input: 'The sky is blue because of Rayleigh scattering',
})
console.log(response.embeddings)

Models

View all →

Name

4 models

Size

Context

Input

bce-reranker-base_v1:latest

304MB · 512 context window · Text · 11 months ago

bce-reranker-base_v1:latest

304MB

512

Text

bce-reranker-base_v1:q4_k_m

219MB · 512 context window · Text · 11 months ago

bce-reranker-base_v1:q4_k_m

219MB

512

Text

bce-reranker-base_v1:q8_0

304MB · 512 context window · Text · 11 months ago

bce-reranker-base_v1:q8_0

304MB

512

Text

bce-reranker-base_v1:f16

564MB · 512 context window · Text · 11 months ago

bce-reranker-base_v1:f16

564MB

512

Text

Readme

No readme