Unable to get intution on how this works

Shubham_Singh3 · April 29, 2022, 11:37am

I am unable to understand how the ReLU will actually activate the input volume .I want to understand how the ReLU will work on this input volume and what will it output

gent.spah · April 29, 2022, 2:09pm

The relu will get as input x+output of last batchnorm, and the relu will functions as it funtcions normally i.e. relu(x+batchnotm).

alvaroramajo · April 29, 2022, 3:39pm

Hi, @Shubham_Singh3!

Just a quick note, as @gent.spah said, the x + output is an element-wise addition, so x and output should have the same dimensions. The original ResNet paper explains this perfectly if you want to dig deeper.

Topic		Replies	Views
Course 4, week 2 : why resnets work (relu activation function and output) Convolutional Neural Networks	1	502	February 24, 2022
Question - Trying to understand how convolution operation works w.r.t input feature volume & output feature volume Convolutional Neural Networks week-1	3	250	March 18, 2024
[Week 2 - CNN] - Output calculation Convolutional Neural Networks	2	491	October 2, 2022
Wk 2, ResNet prog. assign: What's the diff. between X = Activation('relu')(X) and tf.keras.layers.ReLU()(X)? Convolutional Neural Networks	3	518	October 28, 2022
Course 4[Week 1] Convolutions Over Volume - Output image Size Convolutional Neural Networks	6	601	May 22, 2021

Unable to get intution on how this works

Related topics