28 2 weeks ago

T-lite-it-1.0 is a model built upon the Qwen 2.5 model family and incorporates both continual pre-training and alignment techniques (quantized Q4_0)

tools 7b

Models

View all →

Readme

Based on https://ollama.com/rlqd/T-lite-it-1.0:q4_0 and https://huggingface.co/t-tech/T-lite-it-1.0 but with support for tools added (Modelfile changed)

Feature Value
VLM false
think false
tools true
speed 86 token/s

The characteristics are approximate, tested on rtx2080ti 11GB