It's usually the ending that makes me downgrade my rating too. I also factor in re-readability. Most books fall in the "3" category for me, a few might make it into the "4" category, but "5"s are the rarest for me.