A doubt in Deep Q Learning

Dear Administrator,

Could you please guide me on this issue?

“we can estimate the action-value function iteratively by using the Bellman equation”,quoted from C3_W3_A1_Assignment, Section 6 - Deep Q-Learning

image

May i know the reason of labelling i and i+1 differently?

Thank you