“The market for modestly priced second homes, such as those in New Hampshire or Vermont, is weaker than in the past due to its sensitivity to mortgage rates.”