Viewing a single comment thread. View all comments

incrediblediy t1_ix7czdr wrote

Reply to comment by Nerveregenerator in GPU QUESTION by Nerveregenerator

> 4 1080s combined will get me 1.5x throughout as a 3090 with FP32 training. FP16 seems to yield a 1.5x speed up for the 3090 for training.

I think that's when only comparing CUDA cores without Tensor cores, anyway you can't merge VRAM together for large models

3