I think even the Amtrak regional is faster than driving (Acela blows driving out of the water). When driving, It's very difficult to avoid DC and NYC traffic, which can easily tack on 30-60 min (at a minimum). It's at least a 3.5 hour drive without traffic but you have to be speeding to accomplish this.