I wouldn't call it a struggle, more that I just don't tend to put the effort into looking outside my preferred SF&F genre. Not to say that I haven't read novels from other genres, nor that I refuse to, just that there is so much within that genre, that I don't feel much need to branch out.