Precision/Recall on which data?

[rmwkwok]

Hello Navead, how are you?

@naveadjensen

I am curious which data is usually used to present this information, the training, cross validation, or the test data?

You may present precision/recall values on test data to anyone including your company’s CEO.
You may present precision/recall values on cross validation data to your fellow data science colleague to discuss which candidate model is the best.
You may present and compare precision/recall values on training and cv data to decide how to tune your hyperparameters. However, it might not be a good practice to tune the probability threshold value with precision or recall because of the arguments here.

@naveadjensen

It might be useful to look at this curve for the training and cv data while you are tuning the hyper parameters of the model (alpha, lambda, et cetera)

Agreed!

@naveadjensen

it seems like it would be more appropriate to look at and show this plot while using the predictions from the test data, after you have already tuned your model.

Agreed!

Cheers,
Raymond