CoderHD t1_j989j2g wrote on February 20, 2023 at 12:33 AM Reply to comment by MadScientist-1214 in [D] Lion , An Optimizer That Outperforms Adam - Symbolic Discovery of Optimization Algorithms by ExponentialCookie In my limited testing on a UNet like CNN, it doesnt even come close to the performance of adam sadly. With that said, i might be doing something wrong. Permalink Parent 3
CoderHD t1_j989j2g wrote
Reply to comment by MadScientist-1214 in [D] Lion , An Optimizer That Outperforms Adam - Symbolic Discovery of Optimization Algorithms by ExponentialCookie
In my limited testing on a UNet like CNN, it doesnt even come close to the performance of adam sadly. With that said, i might be doing something wrong.