That’s a good point. Actually slightly change your question leads to the problem of neural network width vs depth. Check these materials.

Do Wide and Deep Networks Learn the Same Things?

Universal approximation theorem.