Akrenion t1_j011yxv wrote on December 13, 2022 at 8:27 AM

Reply to comment by midasp in [D] G. Hinton proposes FF – an alternative to Backprop by mrx-ai

U-net is specifically designed for backprop. It the skip connections are helpful for bp. We might need to rethink architectures for other approaches as well.

ChuckSeven t1_j016l2h wrote on December 13, 2022 at 9:33 AM

That's actually a fair point. The optimisation lottery if you will. Where architectures are biased because they are designed around the algorithms that can be scaled and have shown to "work".