Viewing a single comment thread. View all comments

isbtegsm t1_ixz5gei wrote on November 27, 2022 at 3:09 PM

Hello, I have a class of optimization problems (not a neural net) which I want to solve via gradient descent, what is the best library to figure out the best learning parameters (step size, batch size, etc.) given a fixed limit of steps?

froody t1_iy41fpj wrote on November 28, 2022 at 4:22 PM

ray tune is probably a good start

IntelligenXia t1_iy46s6h wrote on November 28, 2022 at 4:58 PM

Hyperopt ( http://hyperopt.github.io/hyperopt/ ) (https://github.com/hyperopt/hyperopt) - Considers limited resources and does not do a brute force !

Optuna (https://github.com/optuna/optuna)