Bias units in CNN

Chinmay_Sahoo · May 13, 2022, 5:32am

I want to clarify how a bias unit is added to a 4x4 image?

is b1 added to all 16 elements to the 4x4 matrix or is b1 a 4x4 matrix itself (I’m pretty sure that in week 1 Andrew mentioned b1 as R, not a 4x4 matrix)?

Nicolas · May 13, 2022, 7:34am

Hello

Your first guess is the right one. You add the same value to each filter component of the output.
If you have 10 filters in a convolutional layer, you will add 1 different value to each result of the convolution operation

You can see that by printing a model sumary and understanding one conv layer number of parameters

Topic		Replies	Views
Calculation the number of bias parameter Convolutional Neural Networks	4	497	April 16, 2024
How many biases are there in one CNN layer? Convolutional Neural Networks	7	744	August 3, 2022
Course 4 #Week 01 : #parameters in CONV2 Convolutional Neural Networks week-1	2	220	March 13, 2024
Convolutional Model Filter Bias Convolutional Neural Networks	3	545	June 26, 2021
HW question about hidden layer parameters Convolutional Neural Networks	3	766	October 13, 2022

Bias units in CNN

Related topics