Viewing a single comment thread. View all comments

learn-deeply t1_j3nx99l wrote

Are you looking to do distributed training across machines? Otherwise the NIC seems complete overkill.

2

joossss OP t1_j3q9uip wrote

Only this server is planned. I just went with the recommendation from NVIDIA's website, which stated 100 Gbps per A100, but I guess it makes more sense now that I think of distributed training. What NIC speed seems enough in that case?

1

learn-deeply t1_j3qdgsl wrote

10Gbps is more than sufficient, data loading from the internet is not the bottleneck. Most likely you'll have the data already stored on the machine itself. Btw why did you remove the post?

2

joossss OP t1_j3qnc04 wrote

Yeah true and thanks :)

I did not remove it. Was removed by the moderators for some reason.

1