# Dropout regularization

**URL:** <https://community.deeplearning.ai/t/dropout-regularization/4024>\
**Category:** Improving Deep Neural Networks: Hyperparameter tun\
**Tags:** coursera-platform\
**Created:** [May 8, 2021, 12:54pm UTC](https://community.deeplearning.ai/t/dropout-regularization/4024 "2021-05-08T12:54:54Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![ajaykumar3456](https://avatars.discourse-cdn.com/v4/letter/a/fbc32d/32.png) [@ajaykumar3456](https://community.deeplearning.ai/u/ajaykumar3456)\
**Post date:** [May 8, 2021, 12:54pm UTC](https://community.deeplearning.ai/t/dropout-regularization/4024/1 "2021-05-08T12:54:54Z")

</div>

In Inverted dropout, we want some units to be zeroed out so that the complexity of the Neural Network decreases.  
After you multiply a3 with d3(A random boolean matrix where elements are less than keep\_prob)  
, you get a matrix a3 with some elements randomly zeroed out which means the zeroed element position indicates that particular hidden unit is eliminated.

But the reason behind scaling (a3/=0.8) is that every value in the matrix is being affected and that should not be the case

Please correct me If I am wrong!

 ![inverted_dropout](https://global.discourse-cdn.com/dlai/original/1X/87644a34b8d5b19b25dc32b8d10119c009ce8bdd.png)

---

<div class="post-metadata">

**Author:** ![nramon](https://sea1.discourse-cdn.com/dlai/user_avatar/community.deeplearning.ai/nramon/32/129097_2.png) [@nramon](https://community.deeplearning.ai/u/nramon)\
**Post date:** [May 10, 2021, 10:16am UTC](https://community.deeplearning.ai/t/dropout-regularization/4024/2 "2021-05-10T10:16:21Z")

</div>

Hi, @ajaykumar3456.

You’ll actually have to implement this in week one’s second assignment! I’m pretty sure you won’t have any problems with it, and I think you should probably remove the code 😅

I tried to explain the reason behind scaling [here](https://community.deeplearning.ai/t/doubt-about-the-implementation-of-inverted-dropout/4007). Let me know if that helped!
