Decision Trees for Regression?

Nope, I do not agree with that statement in general, see also these sources, where I explain why:

The tendency in my opinion is:

  • the bigger the data
  • the more unstructured the data (videos, images)
  • the less domain knowledge you can encode in features
  • the more freedom or capacity your model needs to abstract really complex patterns

→ the stronger the benefits of deep neural networks with modern architectures and advanced layers are compared to traditional or classic ML. Also, when training deep neural networks you can leverage modern digital infrastructure like GPU clusters to accelerate the training.

Basically you have two approaches:

Source

Hope that helps, @Amit_Misra1. All the best! :rocket:

Best regards
Christian