ArcticWinterZzZ t1_jdt1h3m wrote on March 26, 2023 at 11:31 PM

Reply to comment by masonw32 in Why is maths so hard for LLMs? by RadioFreeAmerika

Yes, but we are interested in its general purpose multiplication abilities. If it remembers the results, that's nice, but we can't expect it to do that for every single pair of numbers. And then, what about multiplication with 3 factors? We should start thinking of ways around this limitation.

liqui_date_me t1_jdt48m5 wrote on March 26, 2023 at 11:53 PM

You would think that GPT would have discovered a general purpose way to multiply numbers, but it really hasn’t, and it isn’t accurate even with chain-of-thought prompting.

I just asked GPT4 to solve this: 87176363 times 198364

The right answer should be 17292652070132 according to wolfram alpha.

According to GPT4 the answer is 17,309,868,626,012.

This is the prompt I used:

What is 87176363 times 198364? Think of the problem step by step and give me an exact answer.