Does the sequence models matter in presence of Transformers

Dear Friends,

I would like to ask if studying Sequence models is still important after transformers model evolution.

Thank You,
Ahmed

Transformer architectures are usually large.
So, it’s good to know about layers like RNN, LSTM and GRU.