As long as you renew an NJ license on or after your 21st birthday, the license will be a normal horizontal license. I remember going to the DMV on my birthday to renew it when I turned 21 and it was indeed horizontal (back when they printed it on the spot).

Whether the paper temporary license receipt is valid out of state would really depend on whether or not New York recognizes it.