They make those lined flannel shirts. Depending on price range, could look at Pendleton (if you’re in the USA).

Have you tried either silk knit under layers (e.g. Wintersilks) or Under Armor? That might let you stay warm wearing your usual work clothes