Model from : https://huggingface.co/OpenLLM-France/Luciole-1B-Instruct-1.1-GGUF

Latest is Luciole-1B-Instruct-1.1-Q5_K_M.gguf

Luciole-1B-Instruct-1.1 is a fine-tuned and aligned version of Luciole-1B-Base, an open-source, multilingual causal language model created by OpenLLM-France. Luciole-1B-Instruct-1.1 was developed by LINAGORA and the OpenLLM-France consortium as a part of the OpenLLM France project, funded by BPI France through the France 2030 program.

Training of Luciole-1B-Instruct-1.1 was conducted on Jean Zay in three phases: (i) a supervised fine-tuning (SFT) phase on instruction data with thinking traces, (ii) an SFT phase on instruction data without thinking traces, and (iii) a final preference alignment phase using Direct Preference Optimization (DPO). The training data covers topics in math, science, coding, general chat, RAG and translation.

Note that Luciole-1B-Instruct-1.1 is only the first iteration of post-trained models based on Luciole-1B-Base. Development of the Luciole models is an active, ongoing project and further iterations, including models trained on higher proportions of French data, are planned. In the spirit of open-source, we share the model weights and training recipes to facilitate research and to provide open source building blocks for other training projects.

For more information, see the Luciole-1B-Instruct-1.1 model card. If you are interested in contributing to the Luciole project, contact us at contact@openllm-france.fr.