Why the initialization of weights and bias should be chosen around 0 – datascience.stackexchange.com

Why the initialization of weights and bias should be chosen around 0 – datascience.stackexchange.com

05:34 No Comments
I read this: To train our neural network, we will initialize each parameter W(l)ijWij(l) and each b(l)ibi(l) to a small random value near zero (say according to a Normal(0,ϵ2)Normal(0,ϵ2) ...

from Hot Questions - Stack Exchange OnStackOverflow
via Blogspot

Share this

Unknown

Artikel Terkait

0 Comment to "Why the initialization of weights and bias should be chosen around 0 – datascience.stackexchange.com"

Post a Comment

Subscribe to: Post Comments (Atom)