Dense Layer Initialization does not seems Glorot Uniform

General Discussion
, ,
#1

Hello,

I’ve been working with tf.keras.layers.Dense in tf 2.3 and obtained some strange weights after initialization. With input 63 and output 128 I expected uniform weights from -0.177 to 0.177 following Glorot Uniform initializer (tf.keras.layers.Dense  |  TensorFlow v2.3.0) but I obtained values between -0.4 and 0.4.

I obtained an histogram from weights and my suspiction is it has been initialized following Glorot Normal instead of Glorot Uniform:
albedo_first_layer_weights

Any idea if it is a known bug?

#3

It was just a bug in my code. Thanks :slight_smile: