Submitted by Friedrich_Cainer t3_zklrdx in singularity
spreadlove5683 t1_j01vqsq wrote
Reply to comment by SwipesAndCrappiness in Can we guesstimate chatGPTs impact to job market by 2025? by Friedrich_Cainer
No, 500x parameters doesn't mean 500x more powerful at the very least because GPT3 was trained using incorrect scaling laws. They figured out since then that number of parameters wasn't the bottleneck. I forget if the bottleneck was data, or compute, but don't expect way higher parameter counts in GPT-4 if higher at all. I'm not an expert.
Viewing a single comment thread. View all comments