earthlingkevin t1_j8x9jgh wrote on February 17, 2023 at 4:38 PM

Reply to comment by Psyese in [OC] The cost of training AI on ImageNet has decreased from over $1000 to just under $5 in just 4 years by giteam

At high level our models didn't get much better (there are improvements ofcourse). The biggest change is that instead of training on a small data set, companies started throwing everything on the internet at it.

Psyese t1_j8xbydd wrote on February 17, 2023 at 4:53 PM

So basically investment - more electricity, more expenditure.

earthlingkevin t1_j8xgykb wrote on February 17, 2023 at 5:25 PM

Basically. More money to gcp or azure.

Prestigious-Rip-6767 t1_j8yq0h4 wrote on February 17, 2023 at 10:18 PM

you don't like aws

earthlingkevin t1_j94ynbt wrote on February 19, 2023 at 7:21 AM

Aws is not really the best for ML related things