It's doable but may not be enjoyable. You'll probably be paying a premium to stay in stowe and will have to deal with traffic and a long drive. I'd probably stay somewhere else and just go check out the town of stowe for the day.