Hi, Do you recommend any papers that talks more about why we have changed about the way we currently think about Local Optima in a Higher Dimensional Spaces?

The Problem of Local Optima Lecture

paulinpaloalto April 23, 2022, 4:19pm 2

Yes! There is a great paper from Yann Lecun’s group that specifically addresses those issues. Here is a thread that includes a link to that: https://community.deeplearning.ai/t/cost-function-stuck-at-local-minima/95214/4?u=paulinpaloalto

Topic		Replies	Views
Understanding of local optima in deep networks Improving Deep Neural Networks: Hyperparameter tun	4	595	April 28, 2023
Local Optima with Gradient Descent Improving Deep Neural Networks: Hyperparameter tun	1	546	May 30, 2021
Comparing Perspectives on Dimensionality and Local Optima in Machine Learning Machine Learning Modeling Pipelines in Production	4	392	October 19, 2023
Confused on Saddle Points Improving Deep Neural Networks: Hyperparameter tun	2	514	August 19, 2023
Cost function stuck at local minima Neural Networks and Deep Learning	8	1365	July 5, 2024