Local tradition maintains that the house was built for Richard M. Austin in the late 1870s-1880s. Richard's relationship to local architect Henry Austin is unclear. Thomas P. Dwiggins acquired the house after the Austin daughters sold it out of the family.