A doubt in Week 2 Assignment - Operations on Word Vectors

Course Q&A Deep Learning Specialization Sequence Models
1

Dear Mentor,

Could you please guide me how to understand this formula to adjust the bias part of e_w1B and e_w2B ?

image
image1669×983 108 KB

From my understanding,

This is the unit vector of the difference between e_w1B and u_B
image

This is the unit vector of the difference between e_w2B and u_B
image

I have no idea on this component.
image

Thank you.

2

The point is that the equalized embedding vectors e1 and e2 need to be unit vectors. That is what that factor accomplishes. You can also look at the original paper that they link in the references section.