le4mu
le4mu t1_ja1zj5f wrote
Reply to [D] Best Way to Measure LLM Uncertainty? by _atswi_
I am not in the language community, but in general, I dont think there is the 'best' way for uncertainty measure. In my opinion, the research on uncertainty and out-of-distribution (detection) is still very primitive and without a solid theoretical ground. For a general reference, please have a look at a recent ICLR paper.
le4mu t1_iwi92p2 wrote
Reply to [D] Is it legitimate for reviewers to ask you compare with papers that are not peer-reviewed? by Blasphemer666
If that arxiv paper has high impact (i.e., lots of citations), I think yes.
le4mu t1_iuqqb4g wrote
Reply to comment by OnceReturned in [N] Meta AI | Evolutionary-scale prediction of atomic level protein structure with a language model by xutw21
How is the progress on the first question? The first question seems a fairy tale IMHO, but maybe because I am not in this domain. Could you provide more insights?
le4mu t1_jd8cyno wrote
Reply to [D] 100% accuracy of Random Forest Breast Cancer Prediction by [deleted]
Don't believe a paper until you have their code and run it.