Please support me with two questions
1.) I’m assuming input layer is equivalent to inputs to the model and output layer is equivalent to outputs of the model. Any reason for referring to it as a layer from a mental model perspective?
2.) Secondly, if z = wx + b and y = z, what is the benefit t calling out y = z if it’s functionally equivalent to the first equation? Why isn’t variable z good enough?
btw: already completed the assignment. I’m just asking these questions to help the learning gel.
The term “layer” is useful in neural networks, where you may have more activation units between the input and the output. It’s a simple term that helps describe the complexity of the model.
y does not equal z.
The goal is to minimize the difference between y and z, but you cannot presume the error is always going to be zero.
Thank you. If they are not the same, then why are the variables exactly the same? For example:
First equation: Z(i) = wx(i)+b
second equation: yhat(i) = Z(i)
I’m assuming the Z(i) in the second equation is not the same as the first?
Also, I’m seeing in exercise 2, we are asked to specify the size of the input layer and output layer? What are we asking for in human terms? I’m assuming it’s equivalent to the dependent variables used to predict right for the input layer?
y-hat is another notation for the predictions from the model.
It is not the same as ‘y’.
The terminology is not always used consistently.
The size of the input layer is the number of features in each example in the data set.
The size of the output layer is the number of predictions being made. For linear regression (or for true/false classification), typically there is only one output (called ‘z’ or y_hat, depending on who wrote the exercise).
If you have multiple classes, then you might have more than one output. In that case the output with the highest value represents the predicted class.
