Viewing a single comment thread. View all comments

Cryptizard t1_izu5jlk wrote

Sort of, but look how long it takes to train these models. Even if it can self improve it still might take years to get anywhere.


__ingeniare__ OP t1_izu745z wrote

It's hard to tell how efficient training will be in the future though. According to rumours, GPT-4 training has already started and the cost will be significantly less than that of GPT-3 because of a different architecture. There will be a huge incentive to make the process both cheaper and faster as AI development speeds up. There are many start-ups developing specialized AI hardware that will be used in the coming years. Overall, it's hard to tell how this will play out.