Cool work! You might also enjoy tapenade (tapenade.inria.fr:8080) which takes a C file and then produces a new C source file with the derivative program. It's useful when you want compiled derivatives. I use this a lot for optimization problems; never tried it for NNs, though.
halffloat t1_ja8o7s0 wrote
Reply to [P] Basic autodiff library for scalar values in C by JanBitesTheDust
Cool work! You might also enjoy tapenade (tapenade.inria.fr:8080) which takes a C file and then produces a new C source file with the derivative program. It's useful when you want compiled derivatives. I use this a lot for optimization problems; never tried it for NNs, though.