I have a question regarding, unit 2. I would have expected that the ReLU function cut off at around x = 1.5. The two graphs i circled don’t match. Thank.
Hi @Mo_Okasha,
If it had cut off at x = 1.5, then the outcoming piecewise linear function would have bent at x = 1.5, because starting from x=1.5, we would see the effect by the third ReLU. Therefore, because we wanted it to bend at x=2, the third ReLU had to cut off at x=2.
Raymond