Considering I have the input AT of dimension 43 (3-features & 4-data points) and the weight matrix of dimension 33 (3-features and 3-activation function) what will the be dimension of the bias matrix?
Please someone answer this.
Thank you
Bias is always (number of neurons, 1) dimension. In your example, there are 3 neurons (not activation functions), so b is (3,1).
Best,
Saif.
1 Like