AnimaAnandkumar t1_iwe93vq wrote on November 15, 2022 at 12:06 AM Reply to [R] ZerO Initialization: Initializing Neural Networks with only Zeros and Ones by hardmaru Thank you for posting our paper. These slides sum up our work and how it removes degeneracy arising from identity initialization https://twitter.com/AnimaAnandkumar/status/1590963759954423810?s=20&t=8V3J8VOrbn1w-rZY_Lplqg https://twitter.com/AnimaAnandkumar/status/1590963759954423810?s=20&t=8V3J8VOrbn1w-rZY_Lplqg Permalink 3
AnimaAnandkumar t1_iwe93vq wrote
Reply to [R] ZerO Initialization: Initializing Neural Networks with only Zeros and Ones by hardmaru
Thank you for posting our paper. These slides sum up our work and how it removes degeneracy arising from identity initialization https://twitter.com/AnimaAnandkumar/status/1590963759954423810?s=20&t=8V3J8VOrbn1w-rZY_Lplqg
https://twitter.com/AnimaAnandkumar/status/1590963759954423810?s=20&t=8V3J8VOrbn1w-rZY_Lplqg