Viewing a single comment thread. View all comments

liqui_date_me t1_jdr7fob wrote on March 26, 2023 at 3:38 PM

Reply to comment by CommunismDoesntWork in Why is maths so hard for LLMs? by RadioFreeAmerika

All GPT does is next token prediction, where tokens = words. The lag you see is probably network/bandwidth/queuing issues on the server side rather than the model itself.