LSTM layer size confusion?

Samarth_Gupta · January 7, 2023, 8:09pm

Can someone please explain why the lstm layer size in the ungraded lab is being set equal to the size of the embedding? Shouldn’t it be equal to the size of the number of tokens in a sentence?

Thanks

Elemento · January 8, 2023, 5:39am

Hey @Samarth_Gupta,
Welcome to the community. Please follow the discussion here. You will find out that this discussion discusses your point as well as some other points regarding the LSTM layer size confusion. Let me know if this helps.

Cheers,
Elemento

Topic		Replies	Views
C4W1: Quick question - Number of LSTM units in the model NLP with Attention Models week-1	1	415	March 2, 2024
Why is Units same as size of vocabulary for dense layer Doubt NLP with Attention Models week-1	6	241	April 2, 2024
LSTM of size "d_model" NLP with Sequence Models week-4	1	498	February 28, 2023
What is the dense layer for in week 3 assignment? NLP with Sequence Models week-3	3	577	April 11, 2022
Number of LSTM units in Trax NLP with Sequence Models week-3	12	1296	January 12, 2023

LSTM layer size confusion?

Related topics