Eigenvalues & Eigenvectors quiz- how was the eigenvector derived?

Given eigenvalues as 11 & 1. how do we calculate eigenvectors for the same?

using the formulae, matrix multiplied by the eigen-vector is equal to eigenvalue multiplied by the eigen-vector, I get two equations for one eigenvalue.

eg: for eigenvalue 11
9x + 4y = 11x → -2x + 4x = 0
4x + 3y = 11y → 4x -8y = 0

This seems to be a redundant equation. What am I missing here?

7 Likes

This is to be expected when you have the correct eigenvalues. There should never be a unique solution to Ax = lambda * x since if x is a solution to that equation, then any scalar multiple of x would also fit the criteria. I.e., for any scalar constant c, if Ax = lambda * x, then A(cx) = lambda * (cx), so if x is a valid eigenvector, then so is cx for all c.

In the example you mentioned, both equations simplify to y = x/2, so any multiple of [2, 1] should work. Hope this helps!

4 Likes

This was quite confusing to me as well as in the example provided by the course he does extract some values for x and y having a 0 in the system.

2 Likes

I was having trouble with this too and still don’t understand it. The question and possible answers (and course material up to this point) suggest a unique solution for each eigenvector. So is the answer unique or should it be an infinite range of values for each eigenvector?

3 Likes

I was also stuck on this. I found the answer by checking the provided options and seeing which fit with the constraints for X and Y I found, but that doesn’t feel correct.

Given that infinite possible vectors could satisfy the constraints of the eigenvalues, how do you pick which ones are the eigenvalues?

Hey @Sri_Vardhamanan, @bs80, @titocaput, @stesoye and @farmerinatechstack,
Thanks for raising the question, since after watching the video, this question arises trivially. But before beginning with this reply, I would like to mention that Week 4’s programming assignment highlights and describes this issue as well, along with, how to deal with it while programming. So, feel free to take a look at the assignment once before proceeding with the lecture videos further.


Now, let’s try to delve it a bit deeper into this (using the in-lecture quiz example). In order to find the eigenvalues, we try to do something like follows:

\begin{bmatrix}9 & 4\\4 & 3\end{bmatrix} \begin{bmatrix}x\\y\end{bmatrix} = \begin{bmatrix}\lambda & 0\\0 & \lambda\end{bmatrix} \begin{bmatrix}x\\y\end{bmatrix}

The next step is as follows:

\begin{bmatrix}9 - \lambda & 4\\4 & 3 - \lambda\end{bmatrix} \begin{bmatrix}x\\y\end{bmatrix} = \begin{bmatrix}0\\0\end{bmatrix}

Now, for finding the eigenvalues, we use the fact that this matrix has to have infinite solutions, and hence, this matrix has to be singular, i.e., the determinant of the matrix must be 0. This gives us the eigen-values.

Now, if we take a look at the above equation, \lambda here represents the eigen-values. That means when we substitute the computed eigen-values in place of \lambda, once again, this has to have infinite solutions. In simple words, there are infinite values of x and y, which will satisfy this equation, for both the eigen-values; the very observation which all of us have come across.


In other words, for a given value, we can find infinite eigen-vectors. But the observation to make here is that all of these eigen-vectors are scalar multiples of each other.

Let’s try to see if this is true. This matrix has 2 eigen-values, 1 and 11. Let’s take 1 as an example. In this case, we will substitute \lambda = 1 in the previous equation. We will get the follows:

\begin{bmatrix}9 - 1 & 4\\4 & 3 - 1\end{bmatrix} \begin{bmatrix}x\\y\end{bmatrix} = \begin{bmatrix}0\\0\end{bmatrix}

which will lead to the following equations:

8x + 4y = 0 \\ 4x + 2y = 0

Now, both of these equations are pretty much the same, and will give us the single equation 2x + y = 0 or y = -2x. Now, some of the different vectors satisfying this are as follows:

(1, -2); (2, -4); (-1, 2); (-2, 4) …

But note that all these are scalar multiples of each other.


Now, coming to the last question, “So how do they have decided only one eigen-vector for each eigen-value, out of infinite many?”. Well, I haven’t found it anywhere written specifically, but I could make a teeny tiny observation of my own.

Let’s once again consider the same example. For \lambda = 1, we got the equation of x and y as 2x + y = 0. So, if you follow the below steps in order, you will find the eigen-vector listed in the quiz:

  • Isolate one of the variables such that it has a leading coefficient of +1, and the other variable has an integer coefficient (no fraction). For our example, x = -0.5y and y = -2x both have leading coefficients of isolated variables as +1, but the former has a fractional coefficient for the other variable, so we rule the former one out.
  • Now, for the variable with leading coefficient not equal to 1, substitute +1, and get the value for the other variable.
  • If needed (to match the options), you can multiply the values by -1. Voila, we get the one eigen-vector.

Let’s test this approach out:

  • For \lambda = 1, we get y = -2x, we put x = 1, y = -2. To match the options, multiplying by -1, voila, (-1, 2)
  • For \lambda = 11, we get x = 2y, we put y = 1, x = 2, voila, (2, 1).

Please note that this approach is just for this in-quiz example, and is not some mathematically proven approach :nerd_face:

For any subjective question, you can write any of the infinite eigen-vectors, and you should be good to go, unless they have given you some constraint, for instance, write the eigen-vectors, such that their norm is 1. In that case too, you will have 2 eigen-vectors, since multiplying by -1 won’t change the norm :joy:

For any objective question, choose all the answers will scalar multiples of what you have found as the eigen-vectors.


Resources

Cheers,
Elemento

3 Likes

In addition to @Elemento‘s excellent response;

@Sri_Vardhamanan: side note: the 4x should be 4y:

Also: In tech and engineering, solving Eigenwert problems are often really relevant. If you want to read a bit more, feel free to check out this thread:

Best regards
Christian

I am very disappointed by the course and the solution to the quiz. I have spent 6 hours trying to understand what have I done wrong and came here on the forum just to understand that it is not me! There are actually infinite solutions to the quiz, it’s sad that nothing about this was mentioned in the video and that there was no option in the quiz to chose for infinite solutions :frowning:

3 Likes

Hey @Cristina_Dragomir,
I can’t say that I am fond of how the quiz turned out as well, but what I can say is that, it’s going to be really hard to forget this, since I myself spent a lot of time trying to decode the quiz.

Well, look on the bright side, that’s a surprise left for the learners to unwrap once they reach the programming assignment :nerd_face:

Cheers,
Elemento

1 Like