Reg: ELMo, GPT, BERT, T5 lecture in week 3

Course Q&A Natural Language Processing NLP with Attention Models
1

Hi Moderators,

In ELMo, GPT, BERT, T5 lecture of NLP Course 4 week 3, at 2:53, Younes mentions that ELMo is unidirectional, which contradicts with the reality and also his description of ELMo just prior. Believe he meant that GPT is unidirectional because it uses a decoder and incorporates causal attention.

Request to please correct/update the content for everyone’s benefit.

Thank you.

2

Hi vgumpina,

You are right. I have informed people working at the backend in the hope that this will be adjusted soon. Thanks!