Confidence is key. You were confident you were doing the right thing, no one questioned you because maybe they were wrong instead. Maybe you had told your supervisor that you had to leave early and they forgot.