Submitted by buggaby t3_11qgasm in MachineLearning
MysteryInc152 t1_jc3fuso wrote
Reply to comment by buggaby in [D] Are modern generative AI models on a path to significantly improved truthfulness? by buggaby
From the paper,
>While larger models were less truthful, they were more informative. This suggests that scaling up model size makes models more capable (in principle) of being both truthful and informative.
I suppose that was what i was getting at.
The only hold up with the original paper is that none of the models evaluated were instruct aligned.
But you can see the performance of more models here
https://crfm.stanford.edu/helm/latest/?group=core_scenarios
You can see the text Davinci models are way more truthful than similar sized or even larger models. And the davinci models are more truthful than the smaller aligned Anthropic model.
Viewing a single comment thread. View all comments