BIG EXCEL FILE WITH LLAMA3.1 on Macbook M3 Pro 16GB RAM

AI Discussions
,
1

Hello everyone!

I am having a real problem in my project. I am trying to use Llama3.1 8b model on my macbook m3 that has 16GB RAM. I have 500000 row on my excel data. And on this data I am trying to loop over all rows then get the data from the columns that I neeed to classify brand names. For 100 rows it takes 10 minutes to run. Am I doing something wrong? I stuck at this time. I would love to if somebody help me.

2

Please share a link to your notebook & sample data for someone with the bandwidth to help out.

3

You’re not doing anything wrong, that’s just a huge task to attempt using an online chat tool.

4

Bro have you tried to use Autogluon is a tabular model that help with that just clean it a little bit and train your model on your model on some examples