But we know that wouldn’t work, because of the need for Symmetry Breaking, right?
Here’s what google has to say:
In TensorFlow, the default initialization is Glorot Uniform (Xavier Uniform):
Of course in both platforms, APIs are provided if you want or need to use different initializations, as Balaji and Deepti showed us for torch above.