Viewing a single comment thread. View all comments

minimaxir OP t1_jajcf4s wrote

Reply to comment by LetterRip in [D] OpenAI introduces ChatGPT and Whisper APIs (ChatGPT API is 1/10th the cost of GPT-3 API) by minimaxir

It's safe to assume that some of those techniques were already used in previous iterations of GPT-3/ChatGPT.

30

LetterRip t1_jajezib wrote

June 11, 2020 is the date of the GPT-3 API was introduced. No int4 support and the Ampere architecture with int8 support had only been introduced weeks prior. So the pricing was set based on float16 architecture.

Memory efficient attention is from a few months ago.

ChatGPT was just introduced a few months ago.

The question was 'how OpenAI' could be making a profit, if they were making a profit on GPT-3 2020 pricing; then they should be making 90% more profit per token on the new pricing.

52

jinnyjuice t1_jalkbvu wrote

How do we know these technical improvements result in 90% extra revenue? I feel I'm missing some link here.

0

Smallpaul t1_jam673c wrote

I think you are using the word revenue when you mean profit.

3

LetterRip t1_jani50o wrote

We don't know the supply demand curve, so we can't know for sure that the revenue increased.

1