pdurugyan/qwen3-reranker-0.6b-q8

pdurugyan/ qwen3-reranker-0.6b-q8_0

2,515 Downloads Updated 3 months ago

ggml-org/Qwen3-Reranker-0.6B-Q8_0 - This model was converted to GGUF format from Qwen/Qwen3-Reranker-0.6B using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

embedding tools

ollama pull pdurugyan/qwen3-reranker-0.6b-q8_0

curl http://localhost:11434/api/embed \
  -d '{
    "model": "pdurugyan/qwen3-reranker-0.6b-q8_0",
    "input": "Why is the sky blue?"
  }'

import ollama

response = ollama.embed(
    model='pdurugyan/qwen3-reranker-0.6b-q8_0',
    input='The sky is blue because of Rayleigh scattering',
)
print(response.embeddings)

import ollama from 'ollama'

const response = await ollama.embed({
  model: 'pdurugyan/qwen3-reranker-0.6b-q8_0',
  input: 'The sky is blue because of Rayleigh scattering',
})
console.log(response.embeddings)