Submitted by shitboots t3_zdkpgb in MachineLearning
tchumbae t1_iz55i98 wrote
The idea behind the paper is very cool, but there has been previous work that substitutes the backward pass with a second forward pass. Check out this work by G. Dellaferrera and G. Kreiman!
singularineet t1_iz5q79f wrote
Other relevant prior work: arXiv:2202.0887, Gradients without Backpropagation, by Atılım Güneş Baydin et al, 2022
nikgeo25 t1_iz97ctl wrote
Also the work by Ma and Wright that uses a form of generalized nonlinear PCA. Search ReduNet
Viewing a single comment thread. View all comments