Computer vision to analyse nutrition

Hi all,

I’m looking for a model that can receive a photo of a food as input, and return its nutrition data as output, which is: amount of calories, carbs, fat and protein.

Does such a model exist?

Basically something like this: myfoodrepo.org (it’s only for researchers, so I don’t have access to its model).

Thanks in advance.

Regards,
Shayan

Hi. I don’t know a model, but you can build one using YOLO for image recognition, and getting the nutrition info from some database (I think there is an API for this).

1 Like

Thank you! I’ll check out the YOLO.

Indeed there’s an API for nutrition info: https://www.foodrepo.org

1 Like

Great!

I also just checked a new model from OpenAI called CLIP. I didn’t test it, but it says it works without training… Maybe you can give it a try.

Interesting! Thanks a lot. I’m checking it out :slight_smile:

At least some investors think this is a tractable problem

1 Like

Thanks for sharing! That’s quite some investment, hahah.
I checked it out, and their product kind of works.