Why stop doing that? As I kid I used to skip to the end of books and read the last few pages just so I knew what to expect, then I’d go back and read the rest. I don’t like the artificial tension of fiction so I don’t read it much anymore but when I do I still speed-read through or skip over the parts before the big tension break. Then I just go back and re-read whatever I missed.

I don’t have those issues when I read non-fiction, even narrative non-fiction which flows similarly to fiction. You might want to give that genre a try.