22 Downloads Updated 7 months ago
ollama run richardyoung/sensenova-si-2b:Q4_K_M
The language backbone of SenseTime’s SenseNova-SI-1.1-InternVL3-2B spatial-intelligence model, packaged as a text-only GGUF for fast local inference with Ollama and llama.cpp.
SenseNova-SI is SenseTime’s open-source spatial-intelligence series, built on established multimodal foundations. The 2B member of the family, SenseNova-SI-1.1-InternVL3-2B, is a vision-language model fine-tuned from OpenGVLab/InternVL3-2B, which follows the ViT-MLP-LLM design and pairs an InternViT vision encoder with a Qwen2.5-1.5B language model.
This Ollama distribution is a text-only GGUF conversion of that model: it ships the Qwen2.5 language backbone extracted from the multimodal checkpoint. That is why the GGUF architecture metadata reports qwen2 and uses the ChatML prompt format, it is the LLM core of sensenova/SenseNova-SI-1.1-InternVL3-2B, without the vision encoder. If you need image understanding, use the full multimodal model upstream on Hugging Face; this build is for lightweight text-only chat and reasoning.
Two quantizations are published, both with a 32K context window, sized to run comfortably on laptops and edge hardware.
Two GGUF tags are published. Sizes are taken from the live Ollama page.
| Tag | Size | BPW (approx.) | Notes |
|---|---|---|---|
Q4_K_M |
1.1 GB | ~4.8 | Recommended balance of size and quality |
iq4_xs |
1.0 GB | ~4.25 | Smallest build; lowest memory use |
Pull and run the recommended build:
ollama run richardyoung/sensenova-si-2b:Q4_K_M
Run the smaller quantization:
ollama run richardyoung/sensenova-si-2b:iq4_xs
OpenAI-compatible API:
curl http://localhost:11434/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "richardyoung/sensenova-si-2b:Q4_K_M",
"messages": [{"role": "user", "content": "Describe the spatial relationship between a cup on a table and the floor."}]
}'
| Build | Approx. RAM/VRAM | Best For |
|---|---|---|
iq4_xs |
~2 GB | Edge devices, very constrained hardware |
Q4_K_M |
~3 GB | Laptops and most consumer GPUs |
A modern CPU runs both quants without a GPU; a GPU improves throughput. This is a text-only build, so no vision hardware or image preprocessing is required.
| Property | Value |
|---|---|
| Upstream model | sensenova/SenseNova-SI-1.1-InternVL3-2B (vision-language) |
| Lineage | Fine-tuned from OpenGVLab/InternVL3-2B (ViT-MLP-LLM) |
| Language backbone | Qwen2.5-1.5B |
| This build | Text-only GGUF of the language backbone (no vision encoder) |
| GGUF architecture | qwen2 |
| Parameters | ~2B (Qwen2.5-1.5B core) |
| Context length | 32,768 tokens |
| Prompt format | ChatML |
| Quantization | Q4_K_M, iq4_xs (GGUF) |
| License | Apache 2.0 |
This is a text-only GGUF conversion of the language backbone of a vision-language model; it does not process images, despite the multimodal origin of its parent. It is the original, unmodified Qwen2.5 backbone redistributed for convenience and has not been abliterated or otherwise altered, retaining the alignment of the upstream release. The model is provided “as is” without warranty of any kind. Outputs may be inaccurate, biased, or otherwise unsuitable, verify important information independently and do not rely on the model for professional, legal, medical, or financial advice. You are responsible for ensuring your use complies with the Apache 2.0 license and all applicable laws.
Built & maintained by Richard Young · DeepNeuro