Maybe it isn't just Max, but it's anyone in town who has the knowledge about the person they're trying to mimic. So in other houses it could be different people paralyzed getting their memories sucked out.