Hello,
I have tried to apply the buit-in funtion my_softmax in the Output Handling session, instead the function used in the code (tf.nn.softmax(p_preferred).numpy()).
I was suposing it would have the same return but it doens’t. Why?

Output when running funtion tf.nn.softmax(p_preferred).numpy():

two example output vectors:
[[4.89e-04 2.26e-03 9.84e-01 1.32e-02]
[9.94e-01 6.07e-03 7.60e-05 2.23e-06]]
largest value 0.9999987 smallest value 3.6734e-11

Output when running funtion my_softmax(p_preferred):

two example output vectors:
[[1.69e-08 7.83e-08 3.41e-05 4.55e-07]
[2.16e-04 1.32e-06 1.65e-08 4.84e-10]]
largest value 0.099078394 smallest value 3.2865662e-13

It looks like the output from your (my_softmax) is not normalized, i.,e summation of all elements is not equal to 1. If it is normalized, then, the values seem to be exactly same as tf.nn.softmax.