I'd run the conduit right into the charger, don't bother downsizing the wire. The unused neutral should be left long enough for termination, and capped off and left inside the charger as well. The radius of the bend will be determined by the size of the conduit it's in but basically as long as you don't crunch it/put a kink in it it's a fine radius