If there are 3 input features, 4 neurons in the first layer and 1 neuron in the final output layer. Then these are the dimensions

x is 3*1

w[1] is 4*3

b[1] is 4*1

a[1] is 4*1

w[2] is 1*4

b[2] is 1*1

a[2] is 1*1

Am I correct in saying that these dimensions would not change, if there are now 5 examples?