179 1 week ago

Best OCR model. LightOnOCR-3 is our flagship OCR model family 4B, 1B, and 0.8B with layout, grounding, and visual understanding. We recommend the 4B for most OCR tasks.

vision tools thinking 0.8b 1b 4b
ollama run maternion/LightOnOCR-3:1b

Details

1 week ago

526f149e3b74 · 1.2GB

qwen3
·
596M
·
Q4_K_M
clip
·
410M
·
BF16
{ "temperature": 0.2, "top_k": 0, "top_p": 0.9 }
{{ .Prompt }}

Readme

LightOnOCR-3

Best OCR model. LightOnOCR-3-4B is the largest and most accurate model of the LightOnOCR-3 family, LightOn’s new generation of lightweight end-to-end OCR models with layout and visual understanding. We recommend it for most OCR tasks.

Same architecture as LightOnOCR-2-1B, new capabilities. LightOnOCR-3-1B keeps the architecture of LightOn’s previous LightOnOCR-2 models, so switching requires no change, and adds the new grounding, image description and chart extraction features.

Smallest model. LightOnOCR-3-0.8B is the lightest model of LightOn’s LightOnOCR-3 family, with the same layout and visual understanding features.

image.png

Website | LinkedIn | X

📄 Paper | 📝 Blog | 🚀 Demo | 💻 GitHub | 🤗 LightOnOCR-2-1B

About LightOnOCR-3

LightOnOCR-3 is a new family of highly performant lightweight OCR models. Compared to the previous generation, they bring significant improvements in speed and transcription quality and introduce new visual understanding features: the models now output bounding box coordinates with labels for all visual elements of a document, short descriptions of images, and the numerical data of figures and charts. With these capabilities, they offer a ready-to-use, easier-to-maintain alternative to complex document understanding pipelines.

The models come in three sizes. The 1B keeps the LightOnOCR-2-1B architecture, while the 0.8B and 4B adopt the Qwen3.5 vision-language architecture, which simplifies integration with existing tools and brings a significant speed-up. All models are released under the Apache 2.0 license for research and commercial use.

Highlights

  • 📝 Transcription mode: call the model with an empty prompt and get the full page text, as before. Switching from LightOnOCR-2 requires no change
  • 📍 Grounding mode: call it with the grounding prompt and every block comes back with a label and a bounding box
  • 🖼️ Visual understanding: images get a short description, charts become a table of their data points
  • 🧠 End-to-End: one model instead of a document understanding pipeline, easier to deploy and maintain
  • 🧾 Versatile: handles tables, receipts, forms, charts, multi-column layouts, handwriting, and math notation

Usage with Ollama

4B

ollama run maternion/LightOnOCR-3:4b --think=false

1B

ollama run maternion/LightOnOCR-3:1b

0.8B

ollama run maternion/LightOnOCR-3:0.8b --think=false

Benchmark Results

Our main point of comparison is top open-source and open-weight OCR models that can be downloaded and run locally. Scores are reported by category; higher is better within each table. Bold marks the best score in each column.

image.png

olmOCR-Bench

On olmOCR-Bench, LightOnOCR-3-4B scores 86.3 overall, 1.3 points behind Infinity Parser Pro, which has 35.1B listed parameters. At the same listed 4B size, it scores 0.5 points above Chandra 2. The 4B model leads on ArXiv (91.1), while the 1B variant leads on multi-column pages (85.9) and the 0.8B variant leads on long tiny text (94.1). Infinity Parser Pro remains stronger on old scans and headers/footers. Overall, the 0.8B variant scores 85.5 and the 1B variant scores 84.5.

Model Size (B) ArXiv Old scans math Tables Old scans Headers / footers Multi-column Long tiny text Base Overall
Infinity Parser Pro 35.1 88.1 91.3 91.2 58.2 95.8 83.7 92.5 99.9 87.6
LightOnOCR-3-4B 4.0 91.1 89.1 90.2 52.5 89.2 85.6 93.2 99.5 86.3
Chandra 2 4.0 86.9 89.1 92.1 51.1 91.4 82.1 93.7 99.9 85.8
LightOnOCR-3-0.8B 0.8 89.6 87.6 90.8 48.7 88.2 85.2 94.1 99.7 85.5
LightOnOCR-3-1B 1.0 90.4 80.6 89.9 48.3 87.6 85.9 93.7 99.5 84.5
dots.mocr 3.0 85.9 85.5 90.7 48.2 94.0 85.3 81.6 99.7 83.9
jina-ocr-v1 3.4 86.1 82.3 88.8 42.6 88.7 85.5 93.2 99.9 83.4
Surya OCR 2 0.7 88.3 81.4 86.6 41.8 92.5 82.4 93.7 99.7 83.3
LightOnOCR-2-1B* 1.0 89.6 85.6 89.0 42.2 19.7 84.8 91.4 99.6 83.2*
MistralOCR4.1 – 82.6 72.3 85.9 47.9 91.4 84.5 91.2 99.5 81.9

* The LightOnOCR-2-1B overall score (83.2) excludes headers/footers; the other overall scores include that category. Its score is therefore not directly comparable with the other rows in this column.

ParseBench

On ParseBench, the 4B and 0.8B variants rank first and second on the five-category overall score (75.1 and 74.6), narrowly ahead of Infinity Parser Pro (74.3). The 4B model leads on charts (66.1) and semantic formatting (67.6); Infinity Parser Pro leads on visual grounding (74.9). The 1B variant scores 71.4 overall, with most of its gap to the 0.8B variant coming from charts and visual grounding which highlights the benefits of starting from pre-trained VLMs for visual categories.

Model Size (B) Tables Charts Content faithfulness Semantic formatting Visual grounding Overall (3 cats) Overall (5 cats)
LightOnOCR-3-4B 4.0 83.8 66.1 89.9 67.6 68.3 80.4 75.1
LightOnOCR-3-0.8B 0.8 84.5 64.7 88.9 66.7 68.2 80.1 74.6
Infinity Parser Pro 35.1 86.4 61.3 89.7 59.1 74.9 78.4 74.3
LightOnOCR-3-1B 1.0 84.8 57.3 88.6 64.5 61.7 79.3 71.4
Chandra 2 4.0 89.2 65.1 83.7 61.4 51.2 78.1 70.1
MistralOCR4.1 – 73.9 40.1 89.6 66.4 71.2 76.6 68.2
Surya OCR 2 0.7 82.7 22.0 86.6 61.4 71.6 76.9 64.8
dots.mocr 3.0 85.2 1.0 90.0 47.0 55.8 74.1 55.8
LightOnOCR-2-1B 1.0 75.5 13.5 87.8 63.2 0.0 75.5 48.0
jina-ocr-v1 3.4 74.9 7.5 86.6 60.6 0.0 74.0 45.9

fr-bench-pdf2md

On the French-document fr-bench-pdf2md benchmark, LightOnOCR-3-4B leads overall at 74.1, 3.6 points above the 0.8B variant at 70.5; the 1B variant scores 69.6. The 4B model is strongest on handwritten pages (46.1), forms (49.6), and multi-column layouts (83.6). Other models retain category leads: Chandra 2 on graphics and the second long-table category, and Infinity Parser Pro on tiny text. This spread shows why the overall score alone does not describe every document type.

Model Size (B) Baseline Forms Graphics Hand- written Long table Long table 2 Multi-column Tiny text Overall
LightOnOCR-3-4B 4.0 98.3 49.6 70.5 46.1 83.6 71.7 83.6 88.3 74.1
LightOnOCR-3-0.8B 0.8 98.4 47.8 71.4 33.3 70.9 68.0 80.6 85.4 70.5
LightOnOCR-3-1B 1.0 96.9 40.2 70.8 37.0 82.1 73.0 77.6 80.7 69.6
Chandra 2 4.0 99.7 39.1 75.1 26.1 81.3 79.4 73.3 76.9 69.0
Infinity Parser Pro 35.1 98.0 42.3 63.7 39.4 52.2 38.7 69.7 90.6 63.2
dots.mocr 3.0 98.8 42.3 26.6 18.2 59.0 57.2 77.0 86.7 59.3
Surya OCR 2 0.7 99.8 21.9 26.4 2.4 74.6 67.6 77.0 73.0 54.1
MistralOCR4.1 – 95.9 39.4 55.8 11.5 69.4 59.8 73.3 57.4 54.1
jina-ocr-v1 3.4 99.6 20.1 33.1 3.0 79.1 69.1 74.6 66.5 53.2

Model Variants

Variant Description
LightOnOCR-3-4B Best OCR model, recommended for most tasks
LightOnOCR-3-1B LightOnOCR-2 architecture, drop-in upgrade for existing deployments
LightOnOCR-3-0.8B Fast and Efficient model

Prompt Modes

The models can be used as before in a transcription-only mode: called with an empty prompt (""; the image only), they output all textual elements of the page as markdown. If you are currently using our previous models, switching to LightOnOCR-3 requires no change, as this is the default behavior.

The new usage mode is to call the models with the grounding prompt. They then output the new vision features alongside the transcribed text. Each block of content is prepended with a placeholder giving its type and its bounding box, in page coordinates normalized to 0–1000:

![title](80,70,920,140)
# Company report 2025

![text](80,175,920,225)
Revenue rose 20%.

![image](80,285,460,545)
A solar-powered factory.

![chart](540,285,920,545)
<table>
  <tr><th>Year</th><th>Revenue</th></tr>
  <tr><td>2024</td><td>€10M</td></tr>
  <tr><td>2025</td><td>€12M</td></tr>
</table>
  • Text blocks contain the transcribed content of paragraphs, titles and other text elements.
  • Image blocks pair a bounding box with a short description, making visual content accessible to retrieval and question-answering pipelines.
  • Chart blocks contain an HTML table of the data points extracted from the figure, turning visual information into structured data.

The placeholder label is one of:

Label Definition
text Ordinary body text and paragraphs.
title Document, section, or paragraph headings.
list Bulleted or numbered-list content.
header Text in the page header.
footer Text in the page footer.
page_number Page-number regions.
footnote Footnote text.
caption Captions associated with figures, tables, or other visual elements.
formula Mathematical formulas and equations.
code Code blocks or code-like text.
table Table regions and their content.
image Illustrations, photographs, and other image regions.
chart Charts, graphs, and plotted visual data.
header_image Image regions in page headers, such as logos.
footer_image Image regions in page footers.
aside_text Marginal or side text outside the main text flow.
+ suffix Marks a continuation block, not a separate semantic class.

Grounding adds about 25% output tokens over plain transcription (1,433 vs 1,158 tokens per page on average for the 4B). Other instructions are out of distribution: use the empty prompt ("") or grounding.


Rendering and Preprocessing Tips

Model Tip
4B, 0.8B Render PDFs at 400 DPI to images using a target longest dimension of 2048px
1B Render PDFs at 200 DPI to images using a target longest dimension of 1540px
  • Maintain aspect ratio to preserve text geometry

License

Apache License 2.0


Citation

@misc{lightonocr2_2026,
  title        = {LightOnOCR: A 1B End-to-End Multilingual Vision-Language Model for State-of-the-Art OCR},
  author       = {Said Taghadouini and Adrien Cavaill\`{e}s and Baptiste Aubertin},
  year         = {2026},
  howpublished = {\url{https://arxiv.org/abs/2601.14251}}
}