In addition:
@Hoang_Bui, I am not sure if you only ask about:
- when the weights are being changed
- or also about repeatability of your experiment (if so, feel free to provide a little more information)
Potentially, this thread might be interesting for you since it’s also about the initialisation. Feel free to check it out:
Best regards
Christian