Recombination and uneven numbers of chromosomes as an impediment to viable offspring mostly makes sense in light of preventing chromosomal matching during the fertilization process. So yeah, fertilization occurs, but the resulting zygote is essentially informational garbage that fails to develop appropriately to thrive.