Viewing a single comment thread. View all comments

JustOneAvailableName t1_iujqrr1 wrote on October 31, 2022 at 9:15 PM

Reply to comment by alexnasla in [D] When the GPU is NOT the bottleneck...? by alexnasla

> Its 4 sequential layers, Dense+conv1d+lstm+dense

I thinks this is not enough to saturate the A100. Try to 10x the batch size by just repeating the data. Useless for training, but it should increase GPU utilization without increasing disk utilization. Handy to confirm the bottleneck