Submitted by latefordinnerstudios t3_10r1pg3 in MachineLearning

I made a new open source tool called JellyML that lets you go back to any of your checkpoints, and reproduce your code exactly as it was when you trained it.

You can find the website here:

https://jellyml.com

The GitHub repo:

https://gitHub.com/mmulet/jellyml

You can install it with pip:

pip install jellyml

24

Comments

You must log in or register to comment.

DingusFamilyVacation t1_j6waih9 wrote

I'm excited to try this out. I'm doing most of the ML development on my team. I'll iterate on code development and retrain, multiple times over. Oftentimes, my team members will jump in and want to use a trained model to run some downstream analyses. If the library API has changed, or the model architecture has been tweaked, loading the state_dicts of earlier models becomes nearly impossible without checking out old commits. Even then, storing the results and associating them w commit numbers is super annoying.

Thanks for the tool!

1

BobSteva t1_j6wckhc wrote

Love the donuts on your website!

1

SatoshiNotMe t1_j6wnj9w wrote

Very nice and I appreciate you sharing the code as well as motivation on your blog. The code example to save snapshot looks simple. Did I understand correctly that when you reload a snapshot it puts your current directory into the git state corresponding the checkpoint ?

1

visarga t1_j714oy8 wrote

I save my code and hyper-params in a JSON file in the same folder.

1