ttt05 t1_j0jbubh wrote on December 17, 2022 at 1:55 AM

What you are describing is exactly the problem of OOD detection in image classification. The canonical reference for that would be Dan Hendrycks et. al. 2019. In short, no. Softmax probability might not be the best indicator of confidence as deep networks are often over confident on the wrong outputs.

3nilBarca t1_j0jtiw0 wrote on December 17, 2022 at 4:30 AM

Could you please share the title of the paper you’re referring to since Hendrycks published multiple highly cited papers in 2019?

ttt05 t1_j0ju037 wrote on December 17, 2022 at 4:35 AM

My bad! Here you go! (Also looks like I messed up the years, but all of these are good references)

MSP: https://arxiv.org/abs/1610.02136
OE: https://arxiv.org/pdf/1812.04606.pdf
One vs all: https://arxiv.org/abs/2007.05134

vwings t1_j0l3xlc wrote on December 17, 2022 at 2:02 PM

Yes, indeed the Hendrycks paper is the first to read in this context: https://arxiv.org/abs/1610.02136