In addition to @ahs95‘s great reply:
In that case you have quite a risk of Survivorship Bias. By cross validation you basically can test several splits and more variation of data which should usually help to prevent overfitting compared to the scenario you outlined. Hope that helps, @Jules_Gransden.
Best regards
Christian