Bellman Equation with Misstep Prob

Hello @Antonio_Furtado,

It is the default to move left if they are equal.

Check this out for the result of 0.5 misstep probability.

Can you share a screenshot like in the above link that contains the two tables (Optimal policy and Q(s,a)) for the 0.7 case?

Cheers,
Raymond