For metro north and CT rail you don't need to book in advance. Price will be the same as long as you don't buy the ticket on the train. You can use the station kiosks or buy it on the phone app. The CTrail etix app lets you buy both ct rail and metro north tickets

For amtrak, yes. The earlier you book, the cheaper it is.