Viewing a single comment thread. View all comments

norpadon t1_j1t7342 wrote

Periodicity cannot be learned by a general neural network unless you impose some sort of structural prior onto it (e.g. use periodic activation functions), or transform your inputs accordingly (e.g. nn_input = x % (2*pi))

2

lostmsu t1_j25isru wrote

Try training an NN with `sin` activations to fit a `sin(kx)` for various `k`, and you will find that generally they can't.

1