I don't know off the top of my head, but some quick googling led me to this 2014 paper. The aneuploidies section has some relevant discussion, including details on at least one gene on the X chromosome which we seem to need two copies of, for normal ovary development.

It seems like your crude outline above is correct, but there is much more complexity to the normal development of ovaries beyond this.