Why we need to keep the E[Z^4] from dropping a3?

Course Q&A Deep Learning Specialization Improving Deep Neural Networks: Hyperparameter tun
2

This is a common question. Here’s another recent thread about it. Which also links to this one. On both those links, please read from the given post to the end of the thread to get the full discussion.