autoencoder t1_iwwyabp wrote
> the value quickly gets NaN
Sounds like numerical issues. That could be caused by a too high learning rate.
What does your training error look like across iterations? If it jumps all over the place (increasing a lot maybe), then it's too high, as the step sizes overshoot their targets repeatedly.
IWantAGrapeInMyMouth t1_iwxqrxp wrote
every time i've gotten NaN values it was due to a high learning rate so I second this.
Viewing a single comment thread. View all comments