Usually nothing happens.

Occasionally the law which legalized whatever they were imprisoned for will include a section that pardons people. For instance, Illinois when they legalized Marijuana.