alkaway
alkaway OP t1_j02phdn wrote
Reply to comment by bimtuckboo in [P] Are probabilities from multi-label image classification networks calibrated? by alkaway
Thanks so much for your response! Does temperature scaling change the relative ordering of the probabilities?
alkaway OP t1_j02oy3b wrote
Reply to comment by ResponsibilityNo7189 in [P] Are probabilities from multi-label image classification networks calibrated? by alkaway
Thanks so much for your response! Is temperature scaling the go-to calibration method I should try? Does temperature scaling change the relative ordering of the probabilities?
alkaway OP t1_j02oxhi wrote
Reply to comment by Moderatecat in [P] Are probabilities from multi-label image classification networks calibrated? by alkaway
Thanks so much for your response! Are you aware of any calibration methods I could try? Preferably ones which won't to long to implement / incorporate :P
alkaway OP t1_j02owfb wrote
Reply to comment by trajo123 in [P] Are probabilities from multi-label image classification networks calibrated? by alkaway
Thanks so much for your response! Are you aware of any calibration methods I could try? Preferably ones which won't take long to implement / incorporate :P
alkaway OP t1_j02675d wrote
Reply to comment by [deleted] in [P] Are probabilities from multi-label image classification networks calibrated? by alkaway
I'm not sure I understand. Are you suggesting I normalize each pixel in each NxN label-map to be mean 0 and std of 1? And then use this normalized label-map during training?
alkaway OP t1_j024u31 wrote
Reply to comment by trajo123 in [P] Are probabilities from multi-label image classification networks calibrated? by alkaway
Thanks for your response -- This is an interesting idea! Unfortunately, I am actually training my network to predict 1000+ classes, for which such an idea would be computationally intractable...
alkaway OP t1_j01zhl7 wrote
Reply to comment by pm_me_your_ensembles in [P] Are probabilities from multi-label image classification networks calibrated? by alkaway
Thanks so much for your response!
This makes sense. Are you aware of any techniques that can be used to make these probabilities comparable?
I understand that the outputs shouldn't necessarily be treated as probabilities. I simply want a relative ordering of the pixels in terms of "likelihood."
alkaway OP t1_j02pj3l wrote
Reply to comment by SlowFourierT198 in [P] Are probabilities from multi-label image classification networks calibrated? by alkaway
Thanks so much for your response! Will take a look.