hjmb t1_irzxltz wrote on October 12, 2022 at 8:27 AM

No - layers in neural networks are often a linear map followed by component-wise non-linear maps. The resulting operation is non-linear.

hjmb t1_irzxtrk wrote on October 12, 2022 at 8:30 AM

Note that without the non-linear part each layer would just be a single linear map. The composition of multiple layers would then be a linear map again, so there would be no need for multiple layers in a model.

huehue12132 t1_irzzwkl wrote on October 12, 2022 at 9:02 AM

There are many ML models that are not neural networks.

hjmb t1_is08irx wrote on October 12, 2022 at 10:59 AM

Absolutely, but this was the clearest counter-example I could think of.

A Bayesian-updated linear regression system will indeed give you a linear inference step and count as ML in my opinion.

huehue12132 t1_is2r76e wrote on October 12, 2022 at 9:42 PM

You're right, of course. I think I just misunderstood what you were getting at with your answer when I made that comment.