It turns out that you can’t directly reshape the inputs into the output shape without the transpose, because it ends up “scrambling” the data. You need to preserve the “channels” dimension. Here is a thread which demonstrates why that happens. It might be a good idea to read that thread from the beginning, not just that post that I highlighted.