In the lecture videos in week 2 of class 5, ‘Word2Vec’ a new parameter is introduced, Theta subscript t, however the exact meaning of this term is not clear to me. The lecture describes it as “The parameters associated with output t” or “what is the chance of a particular word t being the label”. I…

Hey DTodd, The subscripts identify one element within a larger object and so, the subscripts on (t) are trying to select one particular element from the given number of words at one particular position. [Capture_T] And so, what are you actually doing is: [Capture_T1] There’s a link that descr…

Thanks Rashmi. And I’ll take a look at the link you included.

In most machine learning literature, the weights are known as “theta”, rather than the ‘w’ used in this course. The two terms are interchangeable.

For those coming here, I’ve tried to get a more detailed follow-up on a related thread: [image] Word2Vec theta matrice Sequence Models Hello @jourdelune863 , You have a vocab of 10,000 words. When you compute p(t | c), you have a context word and a target word.…

Theta parameter introduced In Class 5, week 2

Course Q&A Deep Learning Specialization Sequence Models

mikx March 14, 2024, 1:26am 4

I have the same question and I did not understand the answer.
So, what is Theta? Is it another matrix (which is different from E) or a vector?
Is Theta trainable? If yes, then at which point it gets trained (changed)?

Word2Vec theta matrice

Topic		Replies	Views
Word2Vec theta matrice Sequence Models week-module-2 , coursera-platform	9	339	August 6, 2025
C5W2 Word2Vec video - theta Sequence Models coursera-platform	2	574	January 16, 2023
What exactly is theta in word embeddings? Sequence Models coursera-platform	4	752	May 6, 2023
Why Theta is transposed in Word2Vec Model Sequence Models coursera-platform	1	510	May 25, 2023
Why do we need the softmax parameters in word2vec? Sequence Models coursera-platform	10	631	August 26, 2024

Theta parameter introduced In Class 5, week 2

Related topics