Viewing a single comment thread. View all comments

SatoshiNotMe t1_iwgk7ht wrote

Great work, and congrats!

If I may make a suggestion for future. Suppose I invested months in another RL framework, say SB3 along with its accompanying zoo (experiment manager, trainer etc), plus an elaborate HP tuning (e.g. with RayTune) code. It would be great if you can provide a recipe for how to surgically alter this type of sb3-based code to use CleanRL's model-implementation instead. Granted the recipe cannot address all needs, but even an example would be valuable. Essentially a type of "migration guide" from other frameworks.

Thanks !

2