Viewing a single comment thread. View all comments

Commyende t1_iz2euh0 wrote

Reply to comment by new_name_who_dis_ in [R] The Forward-Forward Algorithm: Some Preliminary Investigations [Geoffrey Hinton] by shitboots

Synapses can be excitatory or inhibitory, so that's basically like positive/negative, but I don't really know if that tracks with this algorithm 100%

8

jms4607 t1_iz38c09 wrote

I think the pos/neg here is more like contrastive learning.

8

new_name_who_dis_ t1_iz2fjjk wrote

It's negative data. It's basically contrastive learning, except without backprop. Like you pass a positive example and then a negative example in each forward pass, and update the weights based on how they fired in each pass.

It's a really cool idea, I'm just interested if it's actually biologically plausible.

I might be wrong but inhibitory synaptic connections sounds like a neural connection with weight 0, i.e. it doesn't fire with the other neuron.

6

Commyende t1_iz2wzk0 wrote

Inhibitory synapses reduce the likelihood of the downstream neuron firing.

6