Submitted by fintechSGNYC t3_1095os9 in MachineLearning
All-DayErrDay t1_j3xttzb wrote
Reply to comment by m98789 in [D] Microsoft ChatGPT investment isn't about Bing but about Cortana by fintechSGNYC
500k, actually (per MosaicML). Will likely drop to 100k soon with H100s being several times faster. Would probably be even lower if you added every efficiency gain currently available.
m98789 t1_j3xxyvm wrote
You are right that the trend is for costs to go down. It was originally reported that it took $12M in compute costs for a single training run of GPT-3 (source).
H100s will make a significant difference and all the optimization techniques. So I agree prices will drop a lot, but for the foreseeable future, still be out of reach for mere mortals.
Viewing a single comment thread. View all comments