guaranteednotabot t1_j9a0q74 wrote on February 20, 2023 at 11:47 AM

Reply to comment by easy_peazy in [D] Simple Questions Thread by AutoModerator

Say there’s a model with double the parameter, will it take twice as long to process?

guaranteednotabot t1_j95m1yr wrote on February 19, 2023 at 12:40 PM

Reply to [D] Simple Questions Thread by AutoModerator

How is the cost of queries to AI tools such as ChatGPT determined?

Sorry for the beginner question, but I keep seeing numbers such as 2 cents per query being quoted for a ChatGPT query.
How much processing power is required to complete a query? Does it scale with the number of parameters - or does number of parameters only affect memory usage?