andersc/qwen3-embedding

andersc/ qwen3-embedding

99 Downloads Updated 6 months ago

Qwen3-Embedding GGUF models

embedding 0.6b 4b 8b

ollama pull andersc/qwen3-embedding:0.6b

curl http://localhost:11434/api/embed \
  -d '{
    "model": "andersc/qwen3-embedding:0.6b",
    "input": "Why is the sky blue?"
  }'

import ollama

response = ollama.embed(
    model='andersc/qwen3-embedding:0.6b',
    input='The sky is blue because of Rayleigh scattering',
)
print(response.embeddings)

import ollama from 'ollama'

const response = await ollama.embed({
  model: 'andersc/qwen3-embedding:0.6b',
  input: 'The sky is blue because of Rayleigh scattering',
})
console.log(response.embeddings)

Models

View all →

Name

3 models

Size

Context

Input

qwen3-embedding:0.6b

639MB · 32K context window · Text · 6 months ago

qwen3-embedding:0.6b

639MB

32K

Text

qwen3-embedding:4b

2.5GB · 40K context window · Text · 6 months ago

qwen3-embedding:4b

2.5GB

40K

Text

qwen3-embedding:8b

4.7GB · 40K context window · Text · 6 months ago

qwen3-embedding:8b

4.7GB

40K

Text

Readme

Embedding models imported from Qwen3-Embedding.

Name	Original File
qwen3-embedding:0.6b	Qwen3-Embedding-0.6B-Q8_0.gguf
qwen3-embedding:4b	Qwen3-Embedding-4B-Q4_K_M.gguf
qwen3-embedding:8b	Qwen3-Embedding-8B-Q4_K_M.gguf