Almawave/
Velvet:latest

1,486 6 months ago

Velvet is an Italian family of large language models (2B, 14B) developed from scratch, featuring a dense architecture.

tools 2b 14b

6 months ago

925eee96383d · 8.5GB

model
llama
·
14.1B
·
Q4_K_M
template
<s>{{- if .Messages }} {{- range $index, $_ := .Messages }} {{- if eq .Role "user" }}<instruction>{{
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
params
{ "num_ctx": 16384, "repeat_last_n": 0, "repeat_penalty": 0.5, "stop": [ "<i

Readme

velvetLogo.png

Velvet is an Italian family of large language models, developed from scratch, featuring a dense architecture. This model was trained on the HPC Leonardo infrastructure hosted by CINECA, utilizing public data that underwent extensive curation.

Velvet-14B: instruct model trained on 6 languages (Italian, English, Spanish, Portuguese-Brazilian, German, French).

Velvet-2B: instruct model trained on 2 languages (Italian, English).

References: