wilgamesh t1_izzoduc wrote on December 13, 2022 at 12:47 AM Reply to [R] The Forward-Forward Algorithm: Some Preliminary Investigations [Geoffrey Hinton] by shitboots Hinton cites Francis Crick's "Function of Sleep" 1983 idea in his list of references. Like the 2nd forward pass that reduces the fitness function of "negative data", Crick proposed REM sleep is "reverse learning" that removes "undesirable modes." Quite elegant to see this implemented... Permalink 1
wilgamesh t1_izzoduc wrote
Reply to [R] The Forward-Forward Algorithm: Some Preliminary Investigations [Geoffrey Hinton] by shitboots
Hinton cites Francis Crick's "Function of Sleep" 1983 idea in his list of references.
Like the 2nd forward pass that reduces the fitness function of "negative data", Crick proposed REM sleep is "reverse learning" that removes "undesirable modes."
Quite elegant to see this implemented...