Is 'state' a concept related to agent or environment?


one of the most used terms during the course is ‘state’. I was a bit confused if it is sth related to the agent or environment which it is interacting with?


1 Like

Here’s how I look at it.

  • Agents have states.
  • Policies determine actions.
  • An action in the environment will result in a new state for the agent.

Hello @saiman,

On top of Tom’s reply, I think state can just be any information that we can make use of to determine the next action for our agent. For example, the surrounding temperature can be an element of the state, and the agent’s velocity can be another element of the state.



So based on your description, we can conclude it is a concept related to the big picture (I mean environment) including agent itself.