Without specifying the answer to the following question, I would propose the noted fix. Without this fix, I believe the quiz question as stated has an incorrect answer.
EXISTING: “With a relatively small set of hyperparameters, it is OK to use a grid search. True/False?”
PROPOSED (given the answer which I am not sharing) “If there is a relatively small set of choices for one particular hyperparameter, it is OK to use a grid search on that hyperparameter. True/False?”
If you have only a single hyperparameter to tune, then the term “grid” doesn’t really apply, right? Well, I guess you could consider a logarithmic or binary search on a single dimension to be a trivial grid search, but it sort of misses the point. Grids are about how to manage searching on more than one dimension simultaneously.
Mind you, it’s been several years since I listened to exactly what Prof Ng says in that section …
My understanding is that “grid” is any-dimensional, from 1 to many dimensions. However, if “grid” cannot be 1-dimensional and must be 2 or more dimensional, I would propose the following rewording of the question:
“If there is a relatively small set of choices for particular hyperparameters, it is OK to use a grid search on those hyperparameters.”
The original wording "With a relatively small set of hyperparameters, it is OK to use a grid search. True/False?” led me to believe that the quiz item was referring to a relatively small set of hyperparameters (for example alpha, epsilon, Betas) each of which has a large number of possible settings. But apparently the interpretation required (which I realized only after seeing the answer) is that “a small set of hyperparameters” refers to a small set off options for a single hyperparameter such as the number of hidden layers or the number of nodes in a single hidden layer. I believe that this interpretation is the less obvious of the two, and therefore the “correct” answer is more likely to be incorrect. I propose the change above as a remedy and would like to know what next steps are to make that happen. Thanks for any advice.