Can you confirm this statement i.e. train set could be from anywhere, but dev/test set should come from same distribution ?
Another statement of 98% train set, 1% dev and 1% test set in modern deep learning era ?
Can you confirm this statement i.e. train set could be from anywhere, but dev/test set should come from same distribution ?
Another statement of 98% train set, 1% dev and 1% test set in modern deep learning era ?
All three should be from the same distribution.
yes, that’s what I felt.
98 1 1 only applies in limited situations.