LLaMA 3.1 8B fine-tuned on verbalized rebus solving in Italian

2 3 months ago

Readme

LLaMA 3.1 8B Verbalized Rebus Solver 🇮🇹

This model is a parameter-efficient fine-tuned version of LLaMA 3.1 8B model trained for verbalized rebus solving in Italian, as part of the release for our paper Non Verbis, Sed Rebus: Large Language Models are Weak Solvers of Italian Rebuses. The task of verbalized rebus solving consists of converting an encrypted sequence of letters and crossword definitions into a solution phrase matching the word lengths specified in the solution key. An example is provided below.

Paper: Non Verbis, Sed Rebus: Large Language Models are Weak Solvers of Italian Rebuses Code: https://github.com/gsarti/verbalized-rebus Data & Checkpoints: 🤗 Hub Collection

If you are using this model in your research, please cite our work as:

@article{sarti-etal-2024-rebus,
    title = "Non Verbis, Sed Rebus: Large Language Models are Weak Solvers of Italian Rebuses",
    author = "Sarti, Gabriele and Caselli, Tommaso and Nissim, Malvina and Bisazza, Arianna",
    journal = "ArXiv",
    month = jul,
    year = "2024",
    volume = {abs/2408.00584},
    url = {https://arxiv.org/abs/2408.00584},
}

Example format

The model already uses a pre-defined user prompt. You should only provide the verbalized rebus and solution key in the following format:

ollama run gsarti/phi3-mini-rebus-solver "Rebus: [Materiale espulso dai vulcani] R O [Strumento del calzolaio] [Si trovano ai lati del bacino] C I [Si ingrassano con la polenta] E I N [Contiene scorte di cibi] B [Isola in francese]\nChiave risolutiva: 1 ' 5 6 5 3 3 1 14"

The model will generate the following answer:

Procediamo alla risoluzione del rebus passo per passo:
- [Materiale espulso dai vulcani] = lava
- R O = R O
- [Strumento del calzolaio] = lesina
- [Si trovano ai lati del bacino] = anche
- C I = C I
- [Si ingrassano con la polenta] = oche
- E I N = E I N
- [Contiene scorte di cibi] = dispensa
- B = B
- [Isola in francese] = ile

Prima lettura: lava R O lesina anche C I oche E I N dispensa B ile

Ora componiamo la soluzione seguendo la chiave risolutiva:
1 = L
' = '
5 = avaro
6 = lesina
5 = anche
3 = ciò
3 = che
1 = è
14 = indispensabile

Soluzione: L'avaro lesina anche ciò che è indispensabile