Viewing a single comment thread. View all comments

seattleite849 OP t1_j734kwb wrote

Reply to comment by swappybizz in [p] I built an open source platform to deploy computationally intensive Python functions as serverless jobs, with no timeouts by seattleite849

Yup, that’s one of our examples! You can run this project to run a stable diffusion model on a serverless GPU: https://github.com/usecakework/cakework/tree/main/examples/image_generation

2

swappybizz t1_j735029 wrote

You have a sign up!

2

seattleite849 OP t1_j736n71 wrote

We are spinning up the serverless gpu hosting the model using banana.dev btw (which I’ve really liked so far). Cakework spins up CPU-only microVMs for now, since the Firecracker virtual machine monitor runs only on CPUs.

1

swappybizz t1_j736x59 wrote

Wow! How do you manage to say afloat?

1

seattleite849 OP t1_j737hp8 wrote

I got a bunch of credits from cloud hosting providers haha. Also since this is a beta I wanted a generous free tier. To connect with banana.dev, you would need to sign up for your own account and pass in your API key to the Python function that’s getting run on cakework. Thin

2