Sundar1583
Sundar1583 t1_ivpjqg3 wrote
In general you need to search for one. Fitting multiple models with a log scale of learning rates and comparing there performance.
If you just want to mess with the model, the default learning rate of 10^-3 usually works very well.
Sundar1583 t1_ivpwl4d wrote
Reply to comment by Meddhouib10 in [D] Best learning rate for fine tuning a pretained CNN by Meddhouib10
10^-3 would be the highest learning rate I’d recommend. It’s just a starting point. Ideally if you want to do search for model performance start at either 10^-3 or 10^-4 and go from there.