Comments

You must log in or register to comment.

suflaj t1_j3ocp85 wrote

Depends how you access it.

Generally yes but if you access it via SSH you'll need to screen or tmux it since disconnecting from the session will also shut down your script.

13

KevinCola t1_j3ofobd wrote

Depends on the service. What cloud service are you using to get access to the GPU?

1

anindya2001 t1_j3og5o2 wrote

Depends upon which platform you use. Services like GCP, Paperspace, AWS, Azure do not close down after you shutdown your PC. However, it also depends upon which platform you're using to access the remote server.

2

Final-Rush759 t1_j3ogyzk wrote

It depends. For colab, only highest tier pro account allow you to turn off the computer. The machine still runs at GCP. Different providers have different setups. I think you don't have to leave browser open if the machine is just port forward to your local machine port. The best is to contact your provider about your instance.

3

snendroid-ai t1_j3ohy1m wrote

If you access the instance through browser, then yes it will be close when you close your browser. You need to SSH in using terminal or browser and use screen command first. Then inside that screen, start your model training or anything else that is using GPU. Now don't terminate screen(google it) and close your SSH session or browser window and your program inside screen will be still running

2

wassimseifeddine t1_j3st329 wrote

These are the things I used

  1. AWS Spot instances. For now it's the optimal solution that I know of
  2. Coreweave. I used them, they're pretty reliable but not sure if they are cheap
  3. LambdaLabs. Not very cheap but reliable. From my usage the lag between keystrokes was significant, I think because they proxy SSH through cloudflare

If you are okay with notebooks then definitely checkout kaggle or colab

EDIT: Added Lambdalabs

2