KGL-DIRECT t1_jdrxsfk wrote on March 26, 2023 at 6:44 PM

Reply to comment by KGL-DIRECT in Why is maths so hard for LLMs? by RadioFreeAmerika

Oh and I also asked GPT to give me 500 randomly generated upper case strings using latin characters and numbers and I asked it to always use a specific text for the first 8 characters. I performed the task by requesting 50 strigs at a time and GPT almost always overshot it and generated 51 to 54 strings for each prompt. One time it was short, it generated only 49.

RadioFreeAmerika OP t1_jduhe5e wrote on March 27, 2023 at 8:14 AM

Thanks for your reply! And what an interesting use case you present. Haven't thought about generating example data for courses yet, but it makes total sense. Just have to check for inconsistencies with the maths I guess. And after having played around with it some more yesterday evening, the model seems to have improved in that regard in the last few days.