vagabond_ t1_j8irc8n wrote on February 14, 2023 at 4:47 PM

Reply to comment by UnrequitedRespect in ChatGPT Passed a Major Medical Exam, but Just Barely | Researchers say ChatGPT is the first AI to receive a passing score for the U.S. Medical Licensing Exam, but it's still bad at math. by chrisdh79

Because AI still has a hard time turning natural language descriptions of quantities into numbers. For instance, it has a very hard time with the difference between 'two' and 'two more'.

accountonbase t1_j8j3arm wrote on February 14, 2023 at 6:04 PM

To be fair, most people struggle with that.

I can't tell you the number of times I've seen "50% increase" to mean the correct thing, only for somebody to use "200% increase" to mean 2x and not 3x the original number.