Your best bet is downtown Fairfield or Blackrock if you can afford it. Keeps you close to the city. You are also close to New Haven and the ferry to LI. Most of CT, even the urban areas, is not walkable. If you don't have kids, Blackrock is the choice. People in Fairfield can be a little extra. Tons of nice people but ... some people who are extra.