LLM fine-tuned to follow instructions in Italian
An open-source LLaMa2 language model of 7b parameters fine-tuned (using as base model NousResearch/Nous-Hermes-llama-2-7b) to follow instructions in italian.
Main Characteristic
This model is a LLM of 7b parameters based on NousResearch/Nous-Hermes-llama-2-7b, a version of meta-llama/Llama-2-7b fine-tuned to follow instructions. The model was further fine-tuned in order to follow instructions in italian, using LoRA approach and a dataset of 120k random pairs of instruction/answer from raicrits/Orca_ITA_200k. The model can be used as is to respond to simple instructions in Italian or can be further fine-tuned to perform specific tasks.
For more details on the usage see at https://huggingface.co/raicrits/Hermes7b_ITA.
Technical Categories
Natural language processing
Last updated
04.03.2024 - 11:39