Viewing a single comment thread. View all comments

ahiddenmessi2 OP t1_jaciwqg wrote

Reply to comment by ggf31416 in [D] Training transformer on RTX2060 by ahiddenmessi2

Thanks for your reply. My goal is to train the transformer to read a specific programming language so I I guess there is no pre trained model available. Seems I have to train it from scratch on my laptop GPU :(

Edit: and yes it has 6gb only

1

ggf31416 t1_jacq8pl wrote

For reference a RTX 3090 can be rented as low as ~ $0.25/hour at vast.ai with just a credit card if you are in a hurry (AWS and GCP require a quota increase to use GPUs), or you may be able to get free credits for research at major cloud providers.

2