Anyone working on deploying LLM in small devices?

→ I would like to work on deploying LLM on small devices . Is anyone there ?

1 Like

This thread would be a better fit if you move it to the “AI Projects” forum area. Your topic isn’t really an “Introduction”.

You can use the “pencil” icon in the thread title to move your thread.

I was able to deploy and runs some models on RPi4.