If you're on a highway, of course. Only a dumbass would be traveling the speed limit in the left lane. The OP mentioned a 50 mph zone, which indicates it's not a highway. If you can safely pull off the road and let somebody pass you on a rural one lane road, that is your prerogative.