UnnAmmEdd
UnnAmmEdd t1_j06rsxu wrote
Reply to comment by mr_birrd in [D] What would happen if you normalize each sample on its on before sending it to the neural net? by xylont
But you need to have min and max values from somewhere (training dataset for example?). This is the point, why you have to normalize entire dataset :P
UnnAmmEdd t1_j0677tu wrote
Reply to [D] What would happen if you normalize each sample on its on before sending it to the neural net? by xylont
>So how about normalizing each sample between a fixed range, say 0 to 1 and then sending them in.
How would you normalize each sample?
UnnAmmEdd t1_j06vfhf wrote
Reply to comment by mr_birrd in [D] What would happen if you normalize each sample on its on before sending it to the neural net? by xylont
Okay, there is nowhere written that we are working on images. If yes, then ofc dividing by 255 doesn't seem to be wrong, it is usually done when casting uint8 to float.
But if doesn't make assumption, that the input is an image (it may be an embedding from token in NLP or a row if we work with tabular data), then input values may be from (-inf, +inf), so we need min/max to put boundaries on this interval.