You're not delusional if you do.

I don't skim or skip. If I find the writer has lost me and I've tuned out for even a sentence, I'll go back and read it again.

So what if you skip entire chapters? Who cares? It's your time, your enjoyment. Spend it how you please.

What you take from a book is up to you and you're not hurting a single other person by skipping anything. If it appalls them that you do so, that's their problem - something they need to deal with.