ttt05

ttt05 t1_j0ju037 wrote on December 17, 2022 at 4:35 AM

Reply to comment by 3nilBarca in [D] Is softmax a good choice for confidence? by thanderrine

My bad! Here you go! (Also looks like I messed up the years, but all of these are good references)

MSP: https://arxiv.org/abs/1610.02136
OE: https://arxiv.org/pdf/1812.04606.pdf
One vs all: https://arxiv.org/abs/2007.05134

ttt05 t1_j0jbubh wrote on December 17, 2022 at 1:55 AM

Reply to [D] Is softmax a good choice for confidence? by thanderrine

What you are describing is exactly the problem of OOD detection in image classification. The canonical reference for that would be Dan Hendrycks et. al. 2019. In short, no. Softmax probability might not be the best indicator of confidence as deep networks are often over confident on the wrong outputs.