Overfitting dev set and no additional data available

Hi there,

do you mean: overfitting is visible on validation set (high loss) but you got a small loss on training set?
(But you still got your final test set untouched in reserve?)

Something like in this plot here?

see also this thread

Have you sufficiently tried e.g the following measures?

  • to reduce the feature space to get a more suitable ratio of data in relation to your feature space (e.g. PCA or PLS or feature selection?)
  • tackled model complexity with regularization / dropout approaches?

Have you considered cross-validation?

Would be great if you also could outline the application, the model and some background information.

Best regards