Submitted by minimaxir t3_11fbccz in MachineLearning
LetterRip t1_jajezib wrote
Reply to comment by minimaxir in [D] OpenAI introduces ChatGPT and Whisper APIs (ChatGPT API is 1/10th the cost of GPT-3 API) by minimaxir
June 11, 2020 is the date of the GPT-3 API was introduced. No int4 support and the Ampere architecture with int8 support had only been introduced weeks prior. So the pricing was set based on float16 architecture.
Memory efficient attention is from a few months ago.
ChatGPT was just introduced a few months ago.
The question was 'how OpenAI' could be making a profit, if they were making a profit on GPT-3 2020 pricing; then they should be making 90% more profit per token on the new pricing.
jinnyjuice t1_jalkbvu wrote
How do we know these technical improvements result in 90% extra revenue? I feel I'm missing some link here.
Viewing a single comment thread. View all comments