pitchdrift t1_j8cjr86 wrote on February 13, 2023 at 8:03 AM

Reply to comment by gahblahblah in Bing Chat blew ChatGPT out of the water on my bespoke "theory of mind" puzzle by Fit-Meet1359

I think rephrasing so that they speak more naturally would help - who would really just say, "Great!" in this scenerio? Immediate flag that this is not an exchange of sincere emotion, even without all the other exposition.

Fit-Meet1359 OP t1_j8cqpdb wrote on February 13, 2023 at 9:45 AM

Happy to re-run the test with any wording you can come up with. I know my question wasn’t perfect and didn’t expect the post to blow up this much.

vtjohnhurt t1_j8d9k88 wrote on February 13, 2023 at 1:32 PM

> Immediate flag that this is not an exchange of sincere emotion

Only if your AI is trained on a bunch of Romance Novels. The emotion behind 'Great!' depends on the tone. The word can express a range of emotions. Real people say 'Great' and mean it sincerely, sarcastically, or some other way.

ArgentStonecutter t1_j8dc7n9 wrote on February 13, 2023 at 1:54 PM

> Real people say 'Great' and mean it literally.

This too. And it's over a phone call. There's no body language, and he may have been busy and she's interrupting him. HE may have been driving as well.