huihui_ai/
granite3.2-vision-abliterated:2b-q8_0

4,725 8 months ago

A compact and efficient vision-language model, specifically designed for visual document understanding, enabling automated content extraction from tables, charts, infographics, plots, diagrams, and more.

vision tools 2b

8 months ago

0544e514f667 · 3.6GB ·

model
granite
·
2.53B
·
Q8_0
projector
clip
·
442M
·
F16
template
{{- /* Tools */ -}} {{- if .Tools -}} <|start_of_role|>available_tools<|end_of_role|> {{- range $ind
system
A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful,
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
params
{ "num_ctx": 16384, "temperature": 0 }

Readme

This is an uncensored version of ibm-granite/granite-vision-3.2-2b created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.

References

HuggingFace

Donation

If you like it, please click ‘like’ and follow us for more updates.
You can follow x.com/support_huihui to get the latest model information from huihui.ai.

Your donation helps us continue our further development and improvement, a cup of coffee can do it.
  • bitcoin:
  bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge