Viewing a single comment thread. View all comments

Borrowedshorts t1_j2ffld8 wrote

Reply to comment by Analog_AI in GPT-3 scores better than humans on Raven’s Progressive Matrices in a display of emergent analogical reasoning by visarga

It seems like most AI companies have been doing this for now. I wonder if they're optimizing a local maxima instead of a global and that the global can only be achieved through further scale.

4

Analog_AI t1_j2fjzjc wrote

They will not stop increasing size. More like taking a breather and squeezing progress from maximizing pre training Also waiting for more cost reduction for scaling. Just a breather. And they also work on tech for beyond the GPT models. More integration of vision recognition and other things will come. Some form of weak AGI will be here in the next 5 years.

3