Full Fine-tuning Initial Weights

When doing full fine tuning, how are the weights of the model initialized?
Should we use random initial weights, or use the base model weights as initial weights?


Initial weights should be starting off at a point where the model is, if its fine tuning! Not just random.