Regularization and Adam and normalization and mini-batch

Course Q&A Deep Learning Specialization Improving Deep Neural Networks: Hyperparameter tun
1

should we always use regularization and Adam and normalization and mini-batch ?

Or should we only use regularization when we find our model has high variance, and use ADAM, normalization, mini-batch when our model is running slowly ?

2

Have you seen this link ?