C5W2 GloVe word vectors: what are the meanings of b_i and b_j?

Course Q&A Deep Learning Specialization Sequence Models
1

Hi, I’m wondering what the meanings of terms b_i and b’_j that appear in the video around 6:30 are? Andrew added these terms on the slide but I couldn’t find where he explained where these two terms came from. Thanks!

2

Hello @Kuang-Han_Huang,

Each word carries a trainable embedding vector and a trainable bias and b means that bias. If you want to dig deeper, you might read the GloVe paper for its section 3.

Cheers,
Raymond

1 Like
3

Thanks so much @rmwkwok !

4

You are welcome, @Kuang-Han_Huang :wink: