Viewing a single comment thread. View all comments

MisterManuscript t1_jdhtan0 wrote

Reply to comment by Rishh3112 in Cuda out of memory error by Rishh3112

You probably have a memory leak somewhere in youe training loop. Either that or your model or batch size is way too big and occupies a lot of vRAM.

Addendum: There's a difference between RAM and vRAM (your GPU's RAM), I hope the 14GB you're talking about is vRAM and not the RAM of your AWS vm.

1

Rishh3112 OP t1_jdhti46 wrote

my model is down here. and my batch size is just 8.

0