Viewing a single comment thread. View all comments

Mental-Swordfish7129 t1_j3q6p7m wrote

Reply to comment by jimmymvp in [N] What's next for AI? by vsmolyakov

The model is generative. Each layer generates predictions about the patterns of the layers below. The bottom layer generates predictions about the sensory data, some of which is proprioception data.

I have never published anything. I do not have that much time and it would largely be redundant. You can look at Friston, et.al. for the math. I use nearly the same math and logic.

What I'm doing bears only a superficial similarity to Gato in my opinion, but I can't say I've looked into it deeply. I've been far too busy with life. I only have my tiny spare time for this project unfortunately.

1

jimmymvp t1_j3q74ms wrote

So the active part is the self-predictive part?

1

Mental-Swordfish7129 t1_j3q81e2 wrote

Active just means that it directly modifies its input stream. And, yes, it is also predicting what that input will be, so it is reasonable to say that it is, in part, self-predictive.

Crucially, its input stream also includes features that are not itself or have not been changed by itself. The proprioceptive signals help it learn which is which.

1