LSTM in pictures: sequential instead of parallel

Greetings!

I think in the speech below it is more accurate to state: “if you hook up a bunch of these in sequence (connect serially)…“ instead of “if you hook up a bunch of these in parallel“, since the picture shows the LSTM blocks connected sequentially.

What do you think?

Right, I think the point here is how is the input being fed and processed. If its simultaneously being fed in different parts at the same time then its “parallel” i.e. the input is split and fed to different parts of the model at the same time.

Otherwise is sequential i.e. being fed in a conveyer belt mode, piece by piece.

1 Like