[D]GPT-4 might be able to tell you if it hallucinatedSubmitted by Cool_Abbreviations_9 t3_123b66w in MachineLearning
meister2983 t1_jdwu6ig wrote
Reply to comment by sineiraetstudio in [D]GPT-4 might be able to tell you if it hallucinated by Cool_Abbreviations_9
It's necessary to improve overall performance; GPT-4 isn't just a thing to answer multiple choice questions.
E.g. Accuracy on adversarial questions (Truthful QA) goes from 40% to 60%.
sineiraetstudio t1_jdwvmxb wrote
Are you talking about RLHF in general? I'm specifically referring to the calibration error, which is separate from accuracy.
meister2983 t1_jdx06k9 wrote
Yes. RLHF both increases accuracy on certain tests while decreasing calibration on others.
Viewing a single comment thread. View all comments