We build neural networks to model the real-world data distribution. If we already know that distribution, we donโt need neural networks. In other words, if we knew everything that may happen, there would be nothing to predict
Evaluation of generative models quite a problem itself