noaradesktop/minicpm-fim

noaradesktop/ minicpm-fim:latest

3 Downloads Updated yesterday

ollama run noaradesktop/minicpm-fim

curl http://localhost:11434/api/chat \
  -d '{
    "model": "noaradesktop/minicpm-fim",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='noaradesktop/minicpm-fim',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'noaradesktop/minicpm-fim',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated yesterday

yesterday

eb2c407500ba · 2.7GB

model

archllama

parameters2.52B

quantizationQ8_0

2.7GB

params

{ "num_predict": 2048, "stop": [ "<|im_start|>", "<|im_end|>" ], "te

107B

template

13B

Readme

Modded maternion/minicpm5:2b with temperature 0 and no template for FIM.

Example:

$ curl http://localhost:11434/api/generate -d '{
  "model": "noaradesktop/minicpm-fim","stream": false,
"prompt": "<|fim_prefix|>from sklearn<|fim_suffix|>pc = PCA(<|fim_middle|>", "raw": true}' | jq -r .

Response:

{
  "model": "noaradesktop/minicpm-fim",
  "response": " .decomposition import P",
...
}