Sigmoid + involvement in gradient descent is not a probability-maker.
So what is probability marker then? Because there is a slide in course one:
I found this topic with similar question What does each neuron really do?
And seems like for now I don’t possess all information needed to cover this question. If yes, feel free to leave me go through necessary courses.