Viewing a single comment thread. View all comments

guaranteednotabot t1_j95m1yr wrote

How is the cost of queries to AI tools such as ChatGPT determined?

Sorry for the beginner question, but I keep seeing numbers such as 2 cents per query being quoted for a ChatGPT query.
How much processing power is required to complete a query? Does it scale with the number of parameters - or does number of parameters only affect memory usage?

1

easy_peazy t1_j98tbgs wrote

They charge per 1000 tokens which is about 750 words. The rate for 1000 tokens is a few cents.

1

guaranteednotabot t1_j9a0q74 wrote

Say there’s a model with double the parameter, will it take twice as long to process?

1