Viewing a single comment thread. View all comments

No_Stretch_9237 t1_j8pd8s0 wrote

Is it possible to run DeepSpeed+ZeRO with a Tesla P40 (24Gb) to make use of my 256gb main system memory during training? If so are there any examples of this particular setup or required cuda driver versions?

1