When Thomas Swann owned it, this house was a Federal structure at the east end of the property. Swann, the original owner, sold it to Henry Daingerfield in 1832. Daingerfield added a Greek Revival wing and in the 1870s severely remodeled the exterior and interior. A massive Second Empire mansard, including arched dormers, and an arcaded porch completely changed the appearance. The property passed to the Sisters of the Holy Cross, who added a massive wing but maintained the mansard and details.