Beware. Whether it's a college student's apartment or a favorite small town restaurant, houses are growing empty.