Viewing a single comment thread. View all comments

Benlus t1_ivyk3bx wrote

Is the code already available somewhere? The applications of the unnormalized sampling are very interesting!

2

julbern OP t1_ivynnso wrote

Thank you for your interest! We are in the process of adding more experiments and extending the code and will release it afterwards.

2

Benlus t1_ivyobom wrote

Nice, Ill keep an eye out for the release! Im working in Bayesian Stats so all the theory presented here seems very intriguing. Could you recommend a starting point to read more about control theory?

2

julbern OP t1_ivyy0g1 wrote

The result from stochastic optimal control that we use in the paper ("verification theorem") originates mainly from the work of M. Pavon (1989) and P. Dai Pra (1991).

Perhaps it is best to start with the lecture notes of R. Van Handel (2007).

For books on the topic, I can further suggest:

  1. W. H. Fleming and R. W. Rishel (1975)
  2. W. H. Fleming and H. M. Soner (2006)
  3. H. Pham (2009)

Some more recent works in this direction are the following:

  1. B. Tzen and M. Raginsky (2019)
  2. N. Nüsken and L. Richter (2021)
  3. M. Pavon (2022)
3