Here are steps to refresh the workspace and get the starter code.
WINDOW_SIZE
given in the starter code can be left unchanged. LSTMs can deal with sequences of length 64.
Your approach towards BATCH_SIZE
is along the right direction.
See this topic to understand how the scale of training data influences model training.
There are a few ungraded labs for course 4 week 4. Here are the links: