Decadz OP t1_j41w1zt wrote
Reply to comment by thchang-opt in [D] Are there any papers on optimization-based approaches which combine learned parameter initializations with learned optimisers? by Decadz
Thanks for the suggestion! Brandon Amos has many great pieces of research. The linked paper is quite long, so I will need to have a more complete reading at a later date to be sure. At a glance though, this tutorial is about meta-optimization theory as opposed to what I was originally asking for which is about application of meta-optimization techniques to learning parameter initialisations + optimizers.
thchang-opt t1_j42820e wrote
I see, well for what it’s worth, here is what I can remember concerning applications:
I believe one of the motivating applications he was looking at was a control problem, where the current world state was one input and the optimization solution produced the optimal control/action to take from this state, according to some fixed problem dynamics. So he was discussing prediction of next solutions in a sequence of (I think convex) optimization problems for real-time control
Decadz OP t1_j433b12 wrote
Great, thanks for the summary!
Viewing a single comment thread. View all comments