He was thrown overboard by an assassin. He doesn't want any investigation into it, so he's saying he doesn't remember. He fully remembers what happened that night.

Of course he could have been drunk.