Viewing a single comment thread. View all comments

joossss OP t1_j3q9uip wrote

Only this server is planned. I just went with the recommendation from NVIDIA's website, which stated 100 Gbps per A100, but I guess it makes more sense now that I think of distributed training. What NIC speed seems enough in that case?

1

learn-deeply t1_j3qdgsl wrote

10Gbps is more than sufficient, data loading from the internet is not the bottleneck. Most likely you'll have the data already stored on the machine itself. Btw why did you remove the post?

2

joossss OP t1_j3qnc04 wrote

Yeah true and thanks :)

I did not remove it. Was removed by the moderators for some reason.

1