RNN dimensions of activation a0

How do I choose the dimensions for the activation vector a0? On which it depends?

The number of hidden units is set by experimentation.