Submitted by neuralbeans t3_10puvih in deeplearning
chatterbox272 t1_j6n3vx6 wrote
Reply to comment by neuralbeans in Best practice for capping a softmax by neuralbeans
My proposed function does that. Let's say you have two outputs, and don't want either to go below 0.25. Your minimum value already adds up to 0.5, so you rescale the softmax to add up to 0.5 as well, giving you a sum of 1 and a valid distribution.
Viewing a single comment thread. View all comments