SgathTriallair t1_ittiv7r wrote
Reply to comment by manOnPavementWaving in Where does the model accuracy increase due to increasing the model's parameters stop? Is AGI possible by just scaling models with the current transformer architecture? by elonmusk12345_
Having difficulty getting the data or physically building the model doesn't mean that the accuracy gains from such a model are diminishing.
That is equivalent to saying asking how fast cars can theoretically go before they fall apart and responding that the speed limit is 65.
It may be difficult to build a 10 trillion parameter model but that doesn't mean it wouldn't be more effective.
Viewing a single comment thread. View all comments