Viewing a single comment thread. View all comments

UnnAmmEdd t1_j06vfhf wrote

Reply to comment by mr_birrd in [D] What would happen if you normalize each sample on its on before sending it to the neural net? by xylont

Okay, there is nowhere written that we are working on images. If yes, then ofc dividing by 255 doesn't seem to be wrong, it is usually done when casting uint8 to float.

But if doesn't make assumption, that the input is an image (it may be an embedding from token in NLP or a row if we work with tabular data), then input values may be from (-inf, +inf), so we need min/max to put boundaries on this interval.

2

mr_birrd t1_j06vp16 wrote

yeah you take the min of the sample and the msx of the sample. If that makes sense is another question.

−2