in addition to the previous responses.
When dealing with a rather limited data amount and structured data, classic machine learning comes in handy as it allows valuable domain knowledge to be built into the model as handcrafted features, which can be helpful:
- not only with respect to interpretability and explainability of the predictions
- but also in terms of the ability to create powerful (but less complex) models with a fairly limited amount of data.
On the other hand: If you know that you will work with Big Data & highly unstructured and high dimensional data in e.g. computer vision (videos, images) or large language models: Deep Learning seems to be an effective tool to solve your challenges, see also this thread.
These sources might be helpful for you:
Please let us know if you have any open questions, @Muhammad_Usama_Amin.
Best regards
Christian