Decadz OP t1_j41w1zt wrote on January 12, 2023 at 4:38 PM

Reply to comment by thchang-opt in [D] Are there any papers on optimization-based approaches which combine learned parameter initializations with learned optimisers? by Decadz

Thanks for the suggestion! Brandon Amos has many great pieces of research. The linked paper is quite long, so I will need to have a more complete reading at a later date to be sure. At a glance though, this tutorial is about meta-optimization theory as opposed to what I was originally asking for which is about application of meta-optimization techniques to learning parameter initialisations + optimizers.

thchang-opt t1_j42820e wrote on January 12, 2023 at 5:52 PM

I see, well for what it’s worth, here is what I can remember concerning applications:

I believe one of the motivating applications he was looking at was a control problem, where the current world state was one input and the optimization solution produced the optimal control/action to take from this state, according to some fixed problem dynamics. So he was discussing prediction of next solutions in a sequence of (I think convex) optimization problems for real-time control

Decadz OP t1_j433b12 wrote on January 12, 2023 at 9:02 PM

Great, thanks for the summary!