Viewing a single comment thread. View all comments

Newhereeeeee t1_jc92ia6 wrote

I’m genuinely asking. What is it that was achieved in 2023 that was meant to be achieved in 2038.


MallFoodSucks t1_jc9wo1q wrote

Nothing. Google has PALM, Meta has FLAVA, Amazon has AlexaTM/CoT, every major tech company has been working on LLM and multimodal models for years. OpenAI was always the benchmark, but the major tech companies are not that far behind - maybe 2-3 years at most. The parameters race has been escalating for awhile now at a rapid pace, so these models were always going to get to this level soon once they scaled sufficiently and had proper training data.

What GPT did better than anyone, was make it a Chatbot. It showcased the power of AI to normal people who don't understand ML. They're also much better at cleaning their data and scaling their model than companies who are more focused on specific business use cases than generic knowledge models.