Dev & Test set should come from same distribution?

Can you confirm this statement i.e. train set could be from anywhere, but dev/test set should come from same distribution ?

Another statement of 98% train set, 1% dev and 1% test set in modern deep learning era ?

All three should be from the same distribution.

1 Like

yes, that’s what I felt.

98 1 1 only applies in limited situations.