Q78KG/gte-Qwen2-1.5B-instruct:q8

Q78KG/ gte-Qwen2-1.5B-instruct:q8_0

245 Downloads Updated 1 year ago

gte-Qwen2-1.5B-instruct is the model in the gte (General Text Embedding).

ollama run Q78KG/gte-Qwen2-1.5B-instruct:q8_0

curl http://localhost:11434/api/chat \
  -d '{
    "model": "Q78KG/gte-Qwen2-1.5B-instruct:q8_0",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='Q78KG/gte-Qwen2-1.5B-instruct:q8_0',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'Q78KG/gte-Qwen2-1.5B-instruct:q8_0',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 year ago

1 year ago

e8e43c7c90db · 1.9GB ·

model

archqwen2

parameters1.78B

quantizationQ8_0

1.9GB

params

{ "stop": [ "<|im_start|>", "<|im_end|>" ] }

38B

template

<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

106B

Readme

Check out the model on huggingface: Alibaba-NLP/gte-Qwen2-1.5B-instruct

To download the model:

ollama run Q78KG/gte-Qwen2-1.5B-instruct:<TAG>

To interact with the model:

curl http://localhost:11434/api/embeddings -d '{ "model": "Q78KG/gte-Qwen2-1.5B-instruct:<TAG>", "prompt": "Your prompt here"}'