How ( the easiest way) to fine tune a LLM model

Hi, id like to custom for example phi4 or llama3.2, if i could some openai model , LLM with custom data.

For example would be nice as i work in a institute, to add some kind of csv files with students, profedsors, marks of students in every subject, professors from other courses…and so on…

Googleing ive found some kind of Unsloth, but as i read you can only make questions and answers… so id need some easy way to custom my LLM ( not closed to one in concrete), and then be able to answer: which is the professor of subject History ?, which students have failed in subject Maths last course?. was the student X enrolled in past years ? and so on…

Would be easier to add some excel or csv or json data…perhaps an sql database.

Thanks