Exactly. Multiple times has it completely failed at simple math. It's a text generative model; it's not supposed to be able to do math really..

It doesn't know everything perfectly, but it does know alot of it pretty good. For example I asked tonight about a show I havent watched in a while; and it was able to refresh me. But it got the exact episode wrong.