bvassie/nemotron-3.5-lightning

bvassie/ nemotron-3.5-lightning

8 Downloads Updated yesterday

NVIDIA Nemotron 3.5 Lightning is an open 30B mixture-of-experts (MoE) model with 3B active parameters built for always-on agents.

ollama run bvassie/nemotron-3.5-lightning:30b-mtp

curl http://localhost:11434/api/chat \
  -d '{
    "model": "bvassie/nemotron-3.5-lightning:30b-mtp",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='bvassie/nemotron-3.5-lightning:30b-mtp',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'bvassie/nemotron-3.5-lightning:30b-mtp',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Models

View all →

Name

1 model

Size / Usage

Context

Input

nemotron-3.5-lightning:30b-mtp

20GB · 1M context window · Text · yesterday

nemotron-3.5-lightning:30b-mtp

20GB

Text

Readme

Created using:

https://huggingface.co/ggml-org/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF

Modelfile:

FROM ./NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Q4_0.gguf
DRAFT ./mtp-NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Q4_0.gguf
TEMPLATE {{ .Prompt }}
RENDERER nemotron-3.5-nano
PARSER nemotron-3.5-nano
PARAMETER draft_num_predict 2
PARAMETER temperature 1
PARAMETER top_p 0.95