Hi! Does anybody know of a good resource that summarizes the state-of-the art understanding around this problem? A good article (academic or non-academic) or a survey paper maybe? Thank you! Mohammad

Understanding of local optima in deep networks

Course Q&A Deep Learning Specialization Improving Deep Neural Networks: Hyperparameter tun

paulinpaloalto April 28, 2023, 6:44am 3

Here’s an earlier thread on this general topic that includes a link to a paper from Yann LeCun’s group on cost surfaces. Please let us know if that looks like it’s relevant for your question.

Topic		Replies	Views
The Problem of Local Optima Lecture Improving Deep Neural Networks: Hyperparameter tun	1	603	April 23, 2022
Local Optima with Gradient Descent Improving Deep Neural Networks: Hyperparameter tun	1	546	May 30, 2021
Cost function stuck at local minima Neural Networks and Deep Learning	8	1365	July 5, 2024
Confused on Saddle Points Improving Deep Neural Networks: Hyperparameter tun	2	514	August 19, 2023
Cost function - How can we make sure that we end up in the global minimum and not one of the local minima Supervised ML: Regression and Classification week-2	2	761	December 3, 2022

Understanding of local optima in deep networks

Related topics