I am confused as to why the accuracy decreases after 5 units.

The model overfits after 5 hiddent units, but since we did not split into training and tests sets yet and the model is fit on all the data shouldn’t the accuracy continue to go up as more hidden units are added?

Maybe we have stopped too early? What happen if you increase `num_iterations`

by 5 times? You might also set `print_cost`

to `True`

so that you can keep track of the cost change.

Cheers,

Raymond

Thank you that worked. 20 units went up to 93% the number of iterations was causing the problem